-- Logs begin at Wed 2021-11-10 15:12:48 UTC, end at Wed 2021-11-10 16:44:38 UTC. -- Nov 10 15:45:38.294884 dv-cinder-817085-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 10 15:45:38.308261 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 10 15:45:38 2021] *** Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: nodename: dv-cinder-817085-2-iscsi Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: machine: x86_64 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: clock source: unix Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: pcre jit disabled Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: detected number of CPU cores: 4 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: current working directory: / Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: detected binary path: /usr/bin/uwsgi-core Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: your processes number limit is 47680 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: your memory page size is 4096 bytes Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: detected max file descriptor number: 2048 Nov 10 15:45:38.310680 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: lock engine: pthread robust mutexes Nov 10 15:45:38.312430 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: thunder lock: enabled Nov 10 15:45:38.312430 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 10 15:45:38.312430 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 10 15:45:38.364085 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: Python main interpreter initialized at 0x55b2f6d3c9c0 Nov 10 15:45:38.364085 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: python threads support enabled Nov 10 15:45:38.364085 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: your server socket listen backlog is limited to 100 connections Nov 10 15:45:38.364085 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: your mercy for graceful operations on workers is 90 seconds Nov 10 15:45:38.364603 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: mapped 403077 bytes (393 KB) for 2 cores Nov 10 15:45:38.364713 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: *** Operational MODE: preforking *** Nov 10 15:45:38.365167 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: *** uWSGI is running in multiple interpreter mode *** Nov 10 15:45:38.365167 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: spawned uWSGI master process (pid: 100942) Nov 10 15:45:38.365525 dv-cinder-817085-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 10 15:45:38.367960 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: spawned uWSGI worker 1 (pid: 100943, cores: 1) Nov 10 15:45:38.367960 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: spawned uWSGI worker 2 (pid: 100944, cores: 1) Nov 10 15:45:38.367960 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 10 15:45:40.061011 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:45:40.061011 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: from cryptography.utils import int_from_bytes Nov 10 15:45:40.061822 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:45:40.061822 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: from cryptography.utils import int_from_bytes Nov 10 15:45:40.092137 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:45:40.092137 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: from cryptography.utils import int_from_bytes Nov 10 15:45:40.093016 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:45:40.093016 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: from cryptography.utils import int_from_bytes Nov 10 15:45:42.825645 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:45:42.826287 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:45:42.826571 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:45:42.826787 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:45:42.826901 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:45:42.827249 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:45:42.827319 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:45:42.827398 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.827658 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:45:42.827767 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.828036 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:45:42.828179 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.828260 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:45:42.828340 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.828686 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.828881 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.828996 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829073 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829309 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829479 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829595 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829693 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.829959 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830108 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830261 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830375 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830519 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830614 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.830861 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-2-iscsi {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831002 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831155 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831269 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831482 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831623 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831799 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.831941 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832119 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832250 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-2-iscsi {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832428 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832575 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832743 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.832886 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.833033 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.833131 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.833359 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.833559 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.833733 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834112 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834270 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834377 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834486 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834797 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.834934 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835116 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835296 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835424 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835506 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835750 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.835852 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.836073 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.836206 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.836480 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.836621 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.836864 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837005 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837241 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837406 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837551 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837756 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-2-iscsi {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.837898 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.838072 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.838298 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.838472 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.838622 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-2-iscsi {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.838873 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839013 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839167 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839315 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839497 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839627 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.839910 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840227 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840413 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840569 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840733 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.840835 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841060 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841156 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841391 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841480 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841717 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.841814 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842030 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842230 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842398 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842530 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842673 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842771 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.842993 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843082 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843310 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843398 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843638 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843738 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.843950 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844037 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844252 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844346 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844501 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844588 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844790 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.844877 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845097 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845186 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845408 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845551 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845742 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845831 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.845992 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846087 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846270 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846362 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846580 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846669 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.846904 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847023 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847206 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847327 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847510 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847601 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847817 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.847906 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848123 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848212 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848452 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848616 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848750 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.848832 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849053 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849144 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849392 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849483 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849700 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.849789 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850021 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850116 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850374 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850463 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850690 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850787 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.850996 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851084 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851315 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851412 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851659 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851753 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.851953 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852035 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852263 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852438 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852608 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852699 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.852921 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853011 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853227 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853321 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853548 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853633 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853866 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.853952 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854188 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854299 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854508 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854597 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854813 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.854904 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855133 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855226 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855450 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855533 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855704 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855795 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.855998 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856082 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856302 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856386 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856606 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856695 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.856919 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857002 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857222 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857321 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857532 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857655 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857835 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.857926 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858132 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858278 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858472 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858623 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858778 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.858935 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859095 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859207 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859379 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859473 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859687 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859770 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.859997 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.860148 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.860375 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.860509 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.860689 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.860782 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861027 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861128 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861353 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861446 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861664 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861770 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.861976 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862081 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862314 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862415 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862630 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862753 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.862952 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.863102 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.863260 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.863367 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.863575 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.863666 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864067 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864175 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864256 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864341 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864510 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.864604 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865226 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865323 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865409 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865496 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865613 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865705 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.865920 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866004 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866265 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866369 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866565 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866648 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866888 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.866970 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867202 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867295 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867518 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867611 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867830 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.867944 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868142 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868238 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868449 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868544 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868763 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.868871 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869060 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869193 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869370 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869491 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869671 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869771 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.869969 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870061 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870316 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870414 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870652 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870815 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.870951 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871116 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871292 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871445 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871563 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871705 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871885 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:45:42.871969 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.872225 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.872307 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.872563 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.872710 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.872906 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873034 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873237 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873376 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873581 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873811 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.873904 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.874252 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.874366 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.874560 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.874702 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.874888 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875080 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875202 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875402 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875497 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875760 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.875848 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876096 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876221 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876429 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876509 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876834 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.876926 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877073 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877205 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877392 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877537 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877688 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.877922 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878054 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878235 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878333 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878554 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878650 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.878887 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879016 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879198 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879332 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879516 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879614 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879844 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.879929 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.880169 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.880268 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.880511 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.880866 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.880949 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881206 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881289 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881525 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881737 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881838 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.881923 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882147 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882257 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882487 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882623 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882798 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.882882 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883110 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883194 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883420 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883513 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883766 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.883892 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884071 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884157 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884381 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884475 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884687 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.884781 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885004 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885089 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885322 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885408 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885632 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885724 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.885937 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886022 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886262 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886350 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886570 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886653 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886874 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.886959 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887199 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887298 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887520 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887604 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887821 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.887914 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888147 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888258 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888445 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888533 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888753 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.888869 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889066 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889158 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889373 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889513 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889699 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.889800 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890008 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890340 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890424 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890668 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890771 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.890976 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891069 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891282 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891368 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891600 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891685 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891906 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.891988 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892209 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892300 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892522 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892606 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892828 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.892911 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893137 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893221 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893445 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893550 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893777 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.893875 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894113 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894231 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894446 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894533 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894779 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.894918 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895104 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895247 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895420 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895648 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895733 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.895979 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896104 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896389 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896595 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896679 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896756 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.896977 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897089 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897288 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897417 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897597 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897726 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.897951 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898051 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898237 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898361 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898545 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898672 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898850 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.898985 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899174 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899293 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899484 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899617 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899790 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.899886 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900094 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900178 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900397 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900480 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900747 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.900841 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901058 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901144 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901371 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901459 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901700 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.901889 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902035 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902128 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902387 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902474 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902704 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.902799 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903025 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903119 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903341 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903425 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903658 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903752 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.903980 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.904119 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.904295 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.904456 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.904687 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.904796 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905008 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905106 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905331 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905425 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905645 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905730 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.905979 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906063 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906315 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906414 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906639 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906714 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.906946 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907041 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907267 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907359 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907576 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907666 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.907898 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908000 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908205 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908306 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908526 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908618 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908855 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.908938 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909175 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909283 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909484 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909569 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909799 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.909882 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910107 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910243 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910446 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910537 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910752 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.910834 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911065 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911207 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911377 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911497 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911707 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.911791 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912038 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912123 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912352 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912465 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912765 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.912849 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913076 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913162 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913393 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913479 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913702 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.913789 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914022 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914114 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914355 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914451 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914678 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914772 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.914998 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915081 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915315 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915406 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915633 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915788 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.915940 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.916032 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.916248 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.916341 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.916558 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.916652 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917230 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917348 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917537 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917644 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917844 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.917951 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918222 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918325 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918483 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918577 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918797 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.918889 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919107 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919207 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919413 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919497 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919720 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.919824 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920030 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920113 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920339 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920423 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920643 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920729 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.920945 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921029 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921254 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921336 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921562 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921646 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921869 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.921953 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.922211 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.922344 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.922532 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.922770 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.922887 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923034 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923161 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923350 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923483 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923659 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.923797 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924011 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924095 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924330 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924429 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924634 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924719 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.924955 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925041 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925310 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925410 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925592 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925677 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925903 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.925987 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.926239 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.926329 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.926558 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.926701 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.926888 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.927010 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.927183 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.927291 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.927627 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.927985 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.928171 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.928493 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.928718 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.928863 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929010 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929149 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929274 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929428 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929565 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929735 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.929877 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930047 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930272 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930431 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930582 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930721 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.930871 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931019 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931187 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931339 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931465 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931587 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931743 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.931867 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.932183 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.932336 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.932522 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.932753 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.932895 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933087 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933244 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933409 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933554 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933728 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.933873 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934053 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934346 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934491 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934617 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934748 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.934897 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935034 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935171 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935343 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935485 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935652 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935813 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.935964 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936258 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936404 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936543 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936664 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.936877 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.937081 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.937285 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.937446 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.937585 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.937714 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938051 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938228 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938370 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938510 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938644 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938764 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938837 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.938911 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.939166 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.939243 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.939477 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.939551 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.939903 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940101 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940101 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940357 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940491 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940613 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940735 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940857 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.940990 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941128 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941300 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941463 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941615 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941829 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.941972 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942082 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942260 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942396 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942594 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942748 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.942872 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943028 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943304 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943485 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943579 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943841 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.943989 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944141 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944225 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944449 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944534 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944770 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.944848 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945078 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945289 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945423 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945559 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945678 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945814 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.945954 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946078 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946270 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946513 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946670 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946794 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.946918 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947039 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947178 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947332 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947451 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947564 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947747 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.947966 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948111 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948293 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948439 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948604 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948757 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.948934 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949090 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949230 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949366 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949542 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949676 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.949849 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950045 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950216 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950336 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950486 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950624 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950792 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.950949 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951085 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951223 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951401 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951535 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951720 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.951935 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952070 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952209 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952325 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952531 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952794 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.952934 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953078 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953243 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953537 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953676 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953855 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.953990 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.954340 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.954486 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.954486 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.954758 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.954895 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955019 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955152 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955276 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955397 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955518 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955678 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955810 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.955990 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956118 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956318 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956466 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956629 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956755 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.956934 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957069 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957245 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957384 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957549 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957689 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957854 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.957990 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.958183 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.958453 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.958648 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.958792 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.958927 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.959064 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.959295 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.959458 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.959601 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.959717 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969219 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969394 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969394 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969679 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969679 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.969942 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.970080 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.970240 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.970467 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.970661 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.970803 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971005 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971146 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971282 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971440 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971575 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971720 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971855 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.971988 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972195 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972344 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972479 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972621 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972754 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.972881 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973033 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973176 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973318 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973450 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973571 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973699 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973843 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.973985 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974116 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974284 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974419 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974538 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974694 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974829 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.974973 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975114 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975247 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975391 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975535 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975674 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975822 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.975958 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976244 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976381 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976524 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976664 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976807 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.976943 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977089 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977237 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977383 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977519 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977690 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977833 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.977981 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978125 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978306 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978441 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978576 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978710 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.978863 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979007 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979143 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979261 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979402 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979553 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979708 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.979868 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980003 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980153 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980270 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980425 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980556 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980747 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.980884 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981028 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981157 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981303 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981447 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981648 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981788 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.981935 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982070 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982309 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982448 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982593 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982730 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.982865 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983013 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983160 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983305 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983445 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983577 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983713 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983858 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.983858 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984116 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984116 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984374 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984516 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984674 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984814 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.984945 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985083 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985217 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985346 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985489 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985637 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985773 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.985911 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986043 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986200 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986359 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986359 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986603 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986603 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.986858 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987003 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987138 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987267 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987402 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987545 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987689 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987848 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.987990 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988123 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988270 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988402 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988536 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988680 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988824 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.988955 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989095 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989232 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989359 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989497 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989629 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989758 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.989951 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.990287 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.990600 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.990747 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.990878 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991012 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991164 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991362 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991518 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991654 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991790 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.991924 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992058 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992189 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992399 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992548 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992683 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992857 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.992993 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993147 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993283 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993413 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993560 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993706 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993849 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.993995 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994129 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994288 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994423 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994557 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994731 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.994974 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995123 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995259 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995393 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995530 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995663 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995808 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.995943 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996085 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996220 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996353 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996503 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996673 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996818 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.996951 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997093 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997234 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997394 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997568 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997726 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997860 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.997992 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998126 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998346 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998480 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998666 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998803 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.998936 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999069 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999201 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999335 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999467 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999600 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999731 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999864 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:42.999994 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000127 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000279 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000444 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000578 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000695 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000814 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.000950 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001091 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001223 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001358 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001476 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001610 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001755 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.001900 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002036 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002234 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002371 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002488 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002636 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.002769 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003041 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003186 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003320 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003455 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003604 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003738 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.003871 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004014 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004160 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004414 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004552 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004685 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004818 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004949 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.004949 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.005205 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.005341 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.005849 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.005996 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006133 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006349 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006511 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006647 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006780 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.006923 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007056 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007201 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007352 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007486 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007616 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007756 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.007891 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008034 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008165 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008308 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008440 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008574 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008707 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008854 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.008993 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009127 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009261 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009395 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009531 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009664 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009799 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.009944 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010076 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010232 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010386 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010540 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010676 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010809 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.010929 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011133 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011290 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011424 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011543 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011678 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011812 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.011946 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.012093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.012228 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.012372 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.012560 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.012881 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013026 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013175 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013311 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013442 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013586 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013722 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.013866 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014013 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014149 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014327 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014459 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014590 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014750 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.014886 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015021 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015156 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015291 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015427 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015582 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015714 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015847 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.015990 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016125 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016260 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016407 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016540 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016808 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.016940 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017084 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017235 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017366 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017500 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017632 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017768 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.017919 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018054 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018248 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018387 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018520 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018653 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018807 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.018953 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019085 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019221 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019364 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019497 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019629 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019749 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.019885 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020020 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020155 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020285 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020432 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020579 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020715 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020851 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.020971 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.021166 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.021432 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.021584 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.021784 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.021924 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022054 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022305 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022443 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022587 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022708 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022841 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.022982 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023128 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023260 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023393 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023527 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023660 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023806 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.023939 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024070 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024213 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024348 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024481 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024630 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024766 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.024899 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025037 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025172 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025320 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025456 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025592 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025725 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.025861 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026006 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026177 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026319 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026454 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026591 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026848 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.026989 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027137 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027271 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027406 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027541 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027679 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027828 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.027965 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028097 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028240 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028377 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028509 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028657 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028795 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.028927 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029057 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029190 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029336 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029482 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029614 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.029905 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030090 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030315 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030475 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030610 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030754 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.030895 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031037 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031167 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031438 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031576 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031721 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.031937 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032076 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032208 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032361 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032496 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032630 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032823 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.032961 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033113 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033262 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033394 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033525 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033671 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033811 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.033955 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034093 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034244 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034394 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034529 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034668 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034819 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.034963 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035101 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035237 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035373 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035507 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035658 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035796 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.035950 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036085 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036220 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036371 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036509 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036643 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.036818 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037046 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037168 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037315 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037463 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037599 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037738 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.037872 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038016 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038224 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038355 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038478 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038627 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038763 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.038880 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039009 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039136 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039256 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039387 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039528 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039674 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039816 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.039949 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040066 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040198 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040342 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040486 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040605 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040726 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.040862 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041008 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041156 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041290 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041421 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041558 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.041687 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042150 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042298 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042446 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042589 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042729 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.042931 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043070 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043219 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043359 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043494 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043625 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043757 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.043888 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044039 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044182 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044323 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044460 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044594 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044723 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.044878 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045024 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045160 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045304 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045438 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045574 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045721 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045856 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.045990 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046123 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046123 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046650 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046650 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046889 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.046889 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047104 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047232 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047376 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047516 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047656 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047787 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.047921 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048052 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048197 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048331 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048463 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048592 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048725 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048854 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.048998 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049134 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049252 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049252 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049479 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049628 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049773 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.049773 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050024 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050146 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050355 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050512 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050650 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050785 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.050926 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051058 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051185 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051387 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051525 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051651 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051786 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.051919 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052052 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052210 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052369 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052496 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052684 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.052879 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053280 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053425 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053560 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053693 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053845 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.053981 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054127 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054346 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054482 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054617 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054746 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.054746 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055015 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055015 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055288 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055288 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055534 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055680 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055817 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.055951 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056085 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056085 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056346 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056492 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056627 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056757 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.056886 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057019 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057152 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057300 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057432 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057432 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057690 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057690 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.057932 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058270 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058410 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058410 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058656 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058656 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058920 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.058920 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059172 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059305 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059440 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059585 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059730 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.059937 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060080 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060216 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060335 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060470 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060610 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.060745 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061058 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061191 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061308 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061449 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061569 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061687 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061822 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.061958 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062099 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062278 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062412 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062532 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062664 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062797 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.062914 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063061 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063179 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063312 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063452 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063585 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063734 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.063868 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064001 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064134 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064266 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064399 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064551 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064686 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064823 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.064963 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065098 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065232 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065386 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065525 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065659 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065795 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.065943 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066094 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066273 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066409 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066545 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066679 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.066981 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.067409 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.067536 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.067675 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.067803 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.068014 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.068386 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069076 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069221 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069344 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069466 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069587 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069709 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.069859 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070017 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070182 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070323 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070462 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070625 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070767 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.070937 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071075 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071214 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071349 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071496 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071616 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071734 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071868 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.071990 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072111 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072259 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072407 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072544 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072679 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072815 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.072961 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073080 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073204 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073323 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073458 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073591 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073738 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.073884 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074017 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074231 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074381 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074516 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074664 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074804 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.074949 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075084 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075219 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075365 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075502 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075723 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.075869 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076004 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076153 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076308 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076454 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076596 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076730 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.076875 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.077021 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:45:43.077180 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:45:43.077330 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:45:43.097959 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_db.sqlalchemy.engines [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.099539 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_db.sqlalchemy.engines [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.276293 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.context [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27f0e8c4-5c31-4fe0-8e0a-0f5398eec656(cell1) {{(pid=100944) load_cells /opt/stack/nova/nova/context.py:464}} Nov 10 15:45:43.280539 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.context [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27f0e8c4-5c31-4fe0-8e0a-0f5398eec656(cell1) {{(pid=100943) load_cells /opt/stack/nova/nova/context.py:464}} Nov 10 15:45:43.280781 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_concurrency.lockutils [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:45:43.282569 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_concurrency.lockutils [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:45:43.283419 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_concurrency.lockutils [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:45:43.284939 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:45:43.285401 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_concurrency.lockutils [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:45:43.287297 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:45:43.288273 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:45:43.290555 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:45:43.299910 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_db.sqlalchemy.engines [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.302629 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_db.sqlalchemy.engines [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.305878 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_db.sqlalchemy.engines [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.309770 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_db.sqlalchemy.engines [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.569872 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG oslo_db.sqlalchemy.engines [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.611617 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_db.sqlalchemy.engines [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:45:43.934813 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: WARNING keystonemiddleware.auth_token [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:45:43.941635 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: WARNING keystonemiddleware.auth_token [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:45:43.951472 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: WARNING keystonemiddleware.auth_token [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:45:43.958633 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: WARNING keystonemiddleware.auth_token [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:45:44.306440 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: WARNING keystonemiddleware.auth_token [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:45:44.312065 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: WARNING keystonemiddleware.auth_token [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:45:44.317373 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2f6d3c9c0 pid: 100944 (default app) Nov 10 15:45:44.319711 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:45:44.321099 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002033 Nov 10 15:45:44.321530 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Nov 10 15:45:44 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:45:44.342011 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: WARNING keystonemiddleware.auth_token [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:45:44.347685 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: WARNING keystonemiddleware.auth_token [None req-4031bd85-3d90-4c7a-92db-7e676f7ed3e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:45:44.354882 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2f6d3c9c0 pid: 100943 (default app) Nov 10 15:47:11.721277 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:11.724285 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003357 Nov 10 15:47:11.725712 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:11 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:12.255079 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-3e6b3a5a-b86d-4e25-b701-f1c4cbdbfb20 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:12.285637 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-3e6b3a5a-b86d-4e25-b701-f1c4cbdbfb20 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.550651 Nov 10 15:47:12.287632 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Nov 10 15:47:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:14.759737 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:14.761589 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-41214d68-9af4-44ee-8449-e4d15a9247f9 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Nov 10 15:47:14.762254 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:14.855530 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-7474dc2c-abac-4ace-b973-edfdd6c8203e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "name": "cirros256", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:14.876042 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:47:14.876042 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:47:14.907606 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-7474dc2c-abac-4ace-b973-edfdd6c8203e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.137552 Nov 10 15:47:14.908282 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:15.132367 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-a3ca6c2d-a88b-4f7a-b4b6-25bdca34cab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:15.134769 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:47:15.134769 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: warnings.warn(msg) Nov 10 15:47:15.188858 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-a3ca6c2d-a88b-4f7a-b4b6-25bdca34cab9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270092 Nov 10 15:47:15.196396 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Nov 10 15:47:14 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:17.615199 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-7474dc2c-abac-4ace-b973-edfdd6c8203e admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:17.616326 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-7474dc2c-abac-4ace-b973-edfdd6c8203e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002520 Nov 10 15:47:17.616758 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:17 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:17.743919 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-da462887-b349-4f70-b710-91b4b8a517d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:17.763511 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:47:17.763511 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: warnings.warn(msg) Nov 10 15:47:17.794435 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-da462887-b349-4f70-b710-91b4b8a517d2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161187 Nov 10 15:47:17.795578 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:17.810485 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-3793ea65-836b-48b9-a722-63d28b54eb24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:17.812741 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:47:17.812741 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:47:17.853694 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-3793ea65-836b-48b9-a722-63d28b54eb24 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048247 Nov 10 15:47:17.861397 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Nov 10 15:47:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:20.258587 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-da462887-b349-4f70-b710-91b4b8a517d2 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:20.259611 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-da462887-b349-4f70-b710-91b4b8a517d2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Nov 10 15:47:20.259977 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:20.331341 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f3fbe1f3-28ab-4397-9645-e46a18c5bd36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:20.354000 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f3fbe1f3-28ab-4397-9645-e46a18c5bd36 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087069 Nov 10 15:47:20.361314 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:20.368193 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-15a04b99-a553-40c7-9638-e17a793c3464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:20.396779 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-15a04b99-a553-40c7-9638-e17a793c3464 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032410 Nov 10 15:47:20.397364 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Nov 10 15:47:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:47:22.776010 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f3fbe1f3-28ab-4397-9645-e46a18c5bd36 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:22.776996 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f3fbe1f3-28ab-4397-9645-e46a18c5bd36 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 10 15:47:22.777403 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:22.847431 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-951cd7f9-89c3-45de-80a5-782f0c99b349 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "rxtx_factor": 1.0}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:22.866397 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-951cd7f9-89c3-45de-80a5-782f0c99b349 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082135 Nov 10 15:47:22.868154 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:22.882492 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-9234f2a8-3ff8-4252-982c-49967cdb7f71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:22.921441 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-9234f2a8-3ff8-4252-982c-49967cdb7f71 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044117 Nov 10 15:47:22.922111 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Nov 10 15:47:22 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:25.496081 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-951cd7f9-89c3-45de-80a5-782f0c99b349 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:25.497840 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-951cd7f9-89c3-45de-80a5-782f0c99b349 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Nov 10 15:47:25.503685 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:25.569282 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:25.593798 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086624 Nov 10 15:47:25.594857 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:25.607768 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-60609707-036f-40c2-8511-9358d69361cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:25.632179 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-60609707-036f-40c2-8511-9358d69361cf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028060 Nov 10 15:47:25.633033 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Nov 10 15:47:25 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:47:28.119526 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:28.120875 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Nov 10 15:47:28.121620 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:47:28.204057 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-58e59e8b-f6c0-49cb-a827-885ee5521044 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:28.232448 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-58e59e8b-f6c0-49cb-a827-885ee5521044 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098246 Nov 10 15:47:28.233549 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Nov 10 15:47:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:47:31.290664 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:31.291991 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-a3df2414-5df6-4b96-97c1-bd50e0179c3e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002380 Nov 10 15:47:31.292789 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:31.375596 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-cd74f9ca-f090-436c-b1a6-41ed926058b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:31.399725 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-cd74f9ca-f090-436c-b1a6-41ed926058b3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.097428 Nov 10 15:47:31.400257 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:31 2021] POST /compute/v2.1/flavors => generated 402 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 10 15:47:31.416927 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-a569742f-67b1-4741-8d09-83d67c7ca29b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:31.444153 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-a569742f-67b1-4741-8d09-83d67c7ca29b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031099 Nov 10 15:47:31.444681 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Nov 10 15:47:31 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:47:33.860543 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-cd74f9ca-f090-436c-b1a6-41ed926058b3 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:33.862209 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-cd74f9ca-f090-436c-b1a6-41ed926058b3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Nov 10 15:47:33.863542 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:33 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:33.933694 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-35115815-dde6-42d8-928f-d1cd27d3c83c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:33.953769 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-35115815-dde6-42d8-928f-d1cd27d3c83c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082790 Nov 10 15:47:33.954762 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 10 15:47:33.967598 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-e960c44b-62fa-4a62-a500-5592781625a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:33.994725 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-e960c44b-62fa-4a62-a500-5592781625a0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030776 Nov 10 15:47:33.995416 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Nov 10 15:47:33 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:36.426491 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-35115815-dde6-42d8-928f-d1cd27d3c83c admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:36.427941 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-35115815-dde6-42d8-928f-d1cd27d3c83c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003082 Nov 10 15:47:36.428661 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:36 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:36.498921 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-75c6ee53-16f8-468e-ab1a-3569f6269b63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "id": "3"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:36.529721 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-75c6ee53-16f8-468e-ab1a-3569f6269b63 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092717 Nov 10 15:47:36.533866 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:36 2021] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:36.553686 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-5862cca1-fbad-4842-af3f-21dc36a88901 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:36.591887 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-5862cca1-fbad-4842-af3f-21dc36a88901 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045260 Nov 10 15:47:36.592769 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Nov 10 15:47:36 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:39.142752 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-75c6ee53-16f8-468e-ab1a-3569f6269b63 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:39.144543 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-75c6ee53-16f8-468e-ab1a-3569f6269b63 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Nov 10 15:47:39.145196 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:39 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:39.247729 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-bc40b72a-d302-47ab-81a0-404b623c5663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "ram": 8192}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:39.272266 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-bc40b72a-d302-47ab-81a0-404b623c5663 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.117912 Nov 10 15:47:39.273166 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:39.288085 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-f17e1bd2-7cf1-40a5-bca9-d26dbfcf38eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:39.325521 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-f17e1bd2-7cf1-40a5-bca9-d26dbfcf38eb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041879 Nov 10 15:47:39.338330 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Nov 10 15:47:39 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:47:41.934591 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-bc40b72a-d302-47ab-81a0-404b623c5663 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:47:41.936275 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-bc40b72a-d302-47ab-81a0-404b623c5663 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Nov 10 15:47:41.936670 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:47:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:47:42.001129 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:42.020513 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076975 Nov 10 15:47:42.021429 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Nov 10 15:47:41 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:47:42.033974 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-0c6ee556-8f24-45c0-8c16-be9843043971 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:47:42.064859 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-0c6ee556-8f24-45c0-8c16-be9843043971 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034383 Nov 10 15:47:42.066446 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Nov 10 15:47:42 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:48:23.314595 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:23.319360 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Nov 10 15:48:23.319360 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:48:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:23.381759 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f53b1e09-2cd4-47c1-9090-178c6e358e4b admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:23.399194 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f53b1e09-2cd4-47c1-9090-178c6e358e4b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074069 Nov 10 15:48:23.399740 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Nov 10 15:48:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:24.964613 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:24.965626 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-147d7cf7-f48f-49f1-81ec-6244f4765192 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 10 15:48:24.966029 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:25.172276 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-645196c5-3d2a-49df-9a14-d0975dbf2aa6 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:25.178652 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.wsgi [None req-645196c5-3d2a-49df-9a14-d0975dbf2aa6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 10 15:48:25.179275 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-645196c5-3d2a-49df-9a14-d0975dbf2aa6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:25.180100 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-645196c5-3d2a-49df-9a14-d0975dbf2aa6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071933 Nov 10 15:48:25.180639 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Nov 10 15:48:25 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:25.195142 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-33ac807a-4594-48a8-9bad-7eae0d7eb5d2 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:25.235334 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-33ac807a-4594-48a8-9bad-7eae0d7eb5d2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.047346 Nov 10 15:48:25.235898 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:25.254186 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-d0e97dbc-4361-4f4a-ab51-0387e114e987 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:25.297433 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-d0e97dbc-4361-4f4a-ab51-0387e114e987 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.049329 Nov 10 15:48:25.298514 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:25.313373 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-d3c9b35b-c066-4b8d-b4c1-c0a530975a42 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:25.319477 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.wsgi [None req-d3c9b35b-c066-4b8d-b4c1-c0a530975a42 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 10 15:48:25.320045 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-d3c9b35b-c066-4b8d-b4c1-c0a530975a42 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:25.320991 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-d3c9b35b-c066-4b8d-b4c1-c0a530975a42 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011445 Nov 10 15:48:25.321577 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Nov 10 15:48:25 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:26.771238 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-d0e97dbc-4361-4f4a-ab51-0387e114e987 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:26.772241 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-d0e97dbc-4361-4f4a-ab51-0387e114e987 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 10 15:48:26.772666 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:26.973856 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-2b5aa170-614d-4aaa-b8a3-ed98b01deb28 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:26.980894 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.wsgi [None req-2b5aa170-614d-4aaa-b8a3-ed98b01deb28 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 10 15:48:26.981654 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-2b5aa170-614d-4aaa-b8a3-ed98b01deb28 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:26.982644 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-2b5aa170-614d-4aaa-b8a3-ed98b01deb28 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064794 Nov 10 15:48:26.983477 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Nov 10 15:48:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:26.994270 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-69fbcc65-0936-437a-8546-a84bd54519c0 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:27.009150 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-69fbcc65-0936-437a-8546-a84bd54519c0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018632 Nov 10 15:48:27.009752 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:27.021313 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-21b8910e-695a-4d75-9100-5c7573f506a1 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:27.037590 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-21b8910e-695a-4d75-9100-5c7573f506a1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020367 Nov 10 15:48:27.038204 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:48:27.049287 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-55d43ebc-1cc9-4151-8caa-64d116ff5861 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:27.055095 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.wsgi [None req-55d43ebc-1cc9-4151-8caa-64d116ff5861 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 10 15:48:27.055654 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-55d43ebc-1cc9-4151-8caa-64d116ff5861 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:27.056446 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-55d43ebc-1cc9-4151-8caa-64d116ff5861 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010856 Nov 10 15:48:27.056966 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Nov 10 15:48:27 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:28.512313 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-21b8910e-695a-4d75-9100-5c7573f506a1 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:28.513693 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-21b8910e-695a-4d75-9100-5c7573f506a1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Nov 10 15:48:28.514240 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:28.717027 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-c18a1de9-f230-4d9d-a9f7-56ddee2d35c2 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:28.722903 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.wsgi [None req-c18a1de9-f230-4d9d-a9f7-56ddee2d35c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 10 15:48:28.723520 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-c18a1de9-f230-4d9d-a9f7-56ddee2d35c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:28.724337 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-c18a1de9-f230-4d9d-a9f7-56ddee2d35c2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064698 Nov 10 15:48:28.724874 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:48:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:28.735026 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-28d1639c-b7d5-4e64-87a5-b0a62e5563c1 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:28.750352 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-28d1639c-b7d5-4e64-87a5-b0a62e5563c1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018785 Nov 10 15:48:28.750909 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:28.761904 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:28.775410 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017541 Nov 10 15:48:28.775983 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Nov 10 15:48:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:48:28.788972 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-410f9c25-6ccf-47d3-8d8a-f234bb4e267b admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:28.795008 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.wsgi [None req-410f9c25-6ccf-47d3-8d8a-f234bb4e267b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 10 15:48:28.795565 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-410f9c25-6ccf-47d3-8d8a-f234bb4e267b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:48:28.796341 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-410f9c25-6ccf-47d3-8d8a-f234bb4e267b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013598 Nov 10 15:48:28.796860 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:48:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:30.246144 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:30.247905 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002435 Nov 10 15:48:30.248442 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:30 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:30.457067 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-d4ff5fca-2a02-457d-ba99-26283267250c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:48:30.477549 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-d4ff5fca-2a02-457d-ba99-26283267250c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078990 Nov 10 15:48:30.478099 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Nov 10 15:48:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:48:31.964735 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:31.965815 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Nov 10 15:48:31.966212 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:32.180031 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-e7f41332-c750-4bdc-9b1f-35b9ad9f5efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:48:32.200185 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-e7f41332-c750-4bdc-9b1f-35b9ad9f5efc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.093264 Nov 10 15:48:32.200764 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Nov 10 15:48:32 2021] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 10 15:48:33.729479 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:33.730537 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 10 15:48:33.730943 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:33.932093 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-b900fc7b-8c1f-401d-a649-5f081be3cafe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:48:33.952913 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-b900fc7b-8c1f-401d-a649-5f081be3cafe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079708 Nov 10 15:48:33.953461 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Nov 10 15:48:33 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:48:35.464187 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:35.465832 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002717 Nov 10 15:48:35.467562 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:35 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:35.757369 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-a446794f-df4b-4308-81a6-03583bd3584f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:48:35.780063 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-a446794f-df4b-4308-81a6-03583bd3584f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085612 Nov 10 15:48:35.780740 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Nov 10 15:48:35 2021] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:48:37.334673 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:37.335673 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Nov 10 15:48:37.336069 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:48:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:48:37.531743 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-0d45e4d5-7e72-4ab4-b463-1770686df61b admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:48:37.552179 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-0d45e4d5-7e72-4ab4-b463-1770686df61b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075584 Nov 10 15:48:37.552776 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Nov 10 15:48:37 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:49:32.617573 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.618633 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-f5917e7f-e57a-4c48-9ed4-a28d2ae472cb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 10 15:49:32.619069 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:49:32.688572 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-aaaed2c9-c032-4077-940e-8936d8099637 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.710095 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-aaaed2c9-c032-4077-940e-8936d8099637 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081215 Nov 10 15:49:32.710705 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:49:32.736681 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-9a4c04ff-9c67-4138-adb5-38e5a7862175 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.746259 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-9a4c04ff-9c67-4138-adb5-38e5a7862175 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013785 Nov 10 15:49:32.746984 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:49:32.760880 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-9bb3480a-7a7b-4044-84ee-5d6e83024b64 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.770201 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-9bb3480a-7a7b-4044-84ee-5d6e83024b64 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013334 Nov 10 15:49:32.770784 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:49:32.784926 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-d09b6f1d-21cf-4e98-9f6f-aafe21afc603 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.793797 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-d09b6f1d-21cf-4e98-9f6f-aafe21afc603 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012674 Nov 10 15:49:32.794423 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:49:32.808319 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:49:32.818704 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014476 Nov 10 15:49:32.819400 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Nov 10 15:49:32 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:51:11.473333 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-3500edc1-3d9f-48f4-85d4-255e4764b702 tempest-verify_tempest_config-395096091 tempest-verify_tempest_config-395096091-project] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:51:11.475386 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-3500edc1-3d9f-48f4-85d4-255e4764b702 tempest-verify_tempest_config-395096091 tempest-verify_tempest_config-395096091-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.126855 Nov 10 15:51:11.475929 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Nov 10 15:51:11 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:52:42.311016 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:42.312325 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Nov 10 15:52:42.312903 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:52:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:52:42.602094 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:42.603528 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:52:42.603528 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:52:42.605191 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:42.605635 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:42.606558 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:42.607124 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:42.644990 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-cb276d0b-05f3-4839-b555-a775f3c4160c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179461 Nov 10 15:52:42.645582 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 35/71] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:52:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:52:44.212446 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:44.213490 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Nov 10 15:52:44.213894 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:52:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:52:44.429150 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:44.430508 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:52:44.430508 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:52:44.432257 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:44.432684 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:44.433483 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:44.433905 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:44.456302 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-d3f8f711-329f-4a36-81d4-8c592c1e0acb admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088219 Nov 10 15:52:44.457380 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:52:44 2021] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:52:56.502224 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:56.503136 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Nov 10 15:52:56.503587 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:52:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:52:56.707961 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:56.709155 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:52:56.709155 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:52:56.710966 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:56.711431 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:56.712286 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:56.712822 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:56.739078 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-a1ce1f11-70c2-4cb1-abf7-29d3f1b21b7f admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089319 Nov 10 15:52:56.739685 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 37/75] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:52:56 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:52:58.290855 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: DEBUG nova.api.openstack.wsgi [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] Calling method '>' {{(pid=100944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:58.291930 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: INFO nova.api.openstack.requestlog [None req-7dfb41c7-e0f8-4f01-896f-194fca5fd593 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Nov 10 15:52:58.292309 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: [pid: 100944|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Nov 10 15:52:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:52:58.508381 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG nova.api.openstack.wsgi [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] Calling method '>' {{(pid=100943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:52:58.509572 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:52:58.509572 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: warnings.warn(msg) Nov 10 15:52:58.511269 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:58.511711 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:58.512522 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:52:58.512943 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: DEBUG oslo_concurrency.lockutils [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:52:58.535909 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: INFO nova.api.openstack.requestlog [None req-ae6a266a-81ed-4633-b13d-4b7e5adcb5a4 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089282 Nov 10 15:52:58.536555 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: [pid: 100943|app: 0|req: 38/77] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Nov 10 15:52:58 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:53:57.780662 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: Wed Nov 10 15:53:57 2021 - graceful shutdown triggered... Nov 10 15:53:57.781582 dv-cinder-817085-2-iscsi devstack@n-api.service[100944]: Gracefully killing worker 2 (pid: 100944)... Nov 10 15:53:57.780798 dv-cinder-817085-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 10 15:53:57.783151 dv-cinder-817085-2-iscsi devstack@n-api.service[100943]: Gracefully killing worker 1 (pid: 100943)... Nov 10 15:53:58.781787 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: worker 1 buried after 1 seconds Nov 10 15:53:58.781787 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: worker 2 buried after 1 seconds Nov 10 15:53:58.781787 dv-cinder-817085-2-iscsi devstack@n-api.service[100942]: goodbye to uWSGI. Nov 10 15:53:58.783639 dv-cinder-817085-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 10 15:53:58.784202 dv-cinder-817085-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 10 15:53:58.787428 dv-cinder-817085-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 10 15:53:58.798123 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 10 15:53:58 2021] *** Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: nodename: dv-cinder-817085-2-iscsi Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: machine: x86_64 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: clock source: unix Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: pcre jit disabled Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: detected number of CPU cores: 4 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: current working directory: / Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: detected binary path: /usr/bin/uwsgi-core Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: your processes number limit is 47680 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: your memory page size is 4096 bytes Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: detected max file descriptor number: 2048 Nov 10 15:53:58.800362 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: lock engine: pthread robust mutexes Nov 10 15:53:58.802449 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: thunder lock: enabled Nov 10 15:53:58.802449 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 10 15:53:58.802449 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 10 15:53:58.855668 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: Python main interpreter initialized at 0x55a5b960a9c0 Nov 10 15:53:58.855668 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: python threads support enabled Nov 10 15:53:58.855668 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: your server socket listen backlog is limited to 100 connections Nov 10 15:53:58.855668 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: your mercy for graceful operations on workers is 90 seconds Nov 10 15:53:58.856400 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: mapped 403077 bytes (393 KB) for 2 cores Nov 10 15:53:58.856400 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: *** Operational MODE: preforking *** Nov 10 15:53:58.856655 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: *** uWSGI is running in multiple interpreter mode *** Nov 10 15:53:58.856655 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: spawned uWSGI master process (pid: 115894) Nov 10 15:53:58.856684 dv-cinder-817085-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 10 15:53:58.857263 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: spawned uWSGI worker 1 (pid: 115910, cores: 1) Nov 10 15:53:58.857789 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: spawned uWSGI worker 2 (pid: 115911, cores: 1) Nov 10 15:53:58.858059 dv-cinder-817085-2-iscsi devstack@n-api.service[115894]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 10 15:54:00.858329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:54:00.858329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: from cryptography.utils import int_from_bytes Nov 10 15:54:00.859121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:54:00.859121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: from cryptography.utils import int_from_bytes Nov 10 15:54:00.926583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:54:00.926583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: from cryptography.utils import int_from_bytes Nov 10 15:54:00.927508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:54:00.927508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: from cryptography.utils import int_from_bytes Nov 10 15:54:03.680870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:54:03.681795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:54:03.681795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:54:03.682077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:54:03.682460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:54:03.682750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.683053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.683389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.683721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.684065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.684390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.684736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.685073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.685415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.685697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.686032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.686411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-2-iscsi {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.686748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.687068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.687522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.687858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.688188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.688531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.688858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.689370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.690298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.690568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.690881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.691247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.691576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.691897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.692233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.692548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.693972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.693972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.693972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-2-iscsi {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.694539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.694539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.696942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.696942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.696942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.696942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.697571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.697571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.697883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.698534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.698534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.698899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.699168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.699444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.699773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.700103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.700442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.700764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.701079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.701496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.701819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.702188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.702514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.703108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.703379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.703624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.703938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.704271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.704589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.704911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.705236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.705559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.705880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.706236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.707880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.707880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.707880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.707880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.707880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.709123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.709123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.709123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.709874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.709874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.710214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.710443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.710797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.711078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.711400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.712347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.712347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.712347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.712791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.713010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.713324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.713584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.713911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.714259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.714587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.714909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.715230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.715549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.715861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.716178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.716504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.716827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.717135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.717453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.717776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.718098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.718498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.718823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.719160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.719581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.719965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.720119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.720410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.720847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.721057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.721523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.721684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.722020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.722364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.722687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.723016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.723330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.723647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.723981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.724398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.724690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.724994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.725318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.725633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.725952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.726293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.726611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.726995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.727235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.727524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.727835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.728170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.728501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.728820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.729137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.729449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.730147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.730503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.730803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.731214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.731470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.731904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.732132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.732463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.732803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.733132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.733468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.733789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.735439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.735439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.735923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.735923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.735923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.736871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.736871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.738864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.739478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.739628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.739869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.740184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.740510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.740849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.741179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.741556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.741819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.742258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.747610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.747610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.747610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.747994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.748199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.748517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.748849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.749184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.749509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.749901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.750753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.750753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.751201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.751201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.751670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.751897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.752132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.752450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.752783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.753101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.753465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.754292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.754292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.754690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.754859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.755123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.755446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.755779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.756105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.756429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.756750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.757074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.757386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.757902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.758070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.758332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.758659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.759043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.759354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.759617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.759934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.760252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.760607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.760923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.761280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.761631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.761961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.762335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.762665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.762994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.763316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.763641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.764530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.764530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.765042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.765042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.765688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.765688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.766052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.766432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.766662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.766865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.767167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.767520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.767876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.768249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.768525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.768847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.769238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.769489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.769818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.770141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.770485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.770816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.771139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.771465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.771788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.772130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.772458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.772784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.773104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.773490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.773836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.774248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.774694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.775120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.775353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.775505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.775774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.776098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.776418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.776728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.777049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.777380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.777692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.778015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.778415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.778671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.778995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.779535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.779721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.780015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.780353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.780805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.781429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.781724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.782237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.782515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.782860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.783163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.783486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.783799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.784116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.784838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.784838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.785868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.785868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.786388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.786388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.786868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.787115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.787359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.787697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.788027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.788509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.789009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.789009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.789495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.789949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.789949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.790499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.790742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.791160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.791160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.791618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.791851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.792381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.792753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.793058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.793392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.793730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.794064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.794484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.795192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.795192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.795861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.795861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.796333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.796590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.796891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.797276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.797694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.798031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.798388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.798783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.799016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.799360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.799591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:54:03.800568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.800568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.801043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:54:03.801371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.801371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.801371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.801803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:54:03.801952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.801952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.802272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:54:03.802465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.802625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:54:03.802808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.802808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.803194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.803384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.803384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.803751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.803906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.803906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.804285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.804622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.804880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.805587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.805587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.806327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.806560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.806560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.807019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.807257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.807257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.807671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.807886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.807886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.808305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.808518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.808518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.809051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.809226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.809226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.809783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.809955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.809955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.810306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.810464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.810464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.811009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-2-iscsi {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.811237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.811578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.811736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.811736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.812147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.812421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.812421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.812730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.812880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.812880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.813167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.813308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.813308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.813583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.813733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.813733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.814029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.814194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.814194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.814491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.814642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.814642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.814642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.815086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.815265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.815265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.815875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.816037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.816037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.816485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.816639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.816639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.819424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.820475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.820475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.820773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.820973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.820973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.821433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.821889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.821889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.822202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.822367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.822512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.822661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.822661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.822981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.823137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.823137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.823471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.823625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.823625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.823916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.824082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.824082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.824429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-2-iscsi {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.824600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.824600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.824891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.825040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.825040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.825323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.825472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.825472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.826150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.826385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.826385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.826926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.827071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.827071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.827358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.827505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.827505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.827780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.829886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.829886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.830359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.830595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.830595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.831028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.831267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.831267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.832942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.833179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.833179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.833640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.833870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.833870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.833870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.833870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.834884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.835043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.835204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.835953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.835953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.836824 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.837968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.837968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.838595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.838827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.838827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.839397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.839913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.839913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.840994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.841244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.841244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.846691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.847024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.847263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.847510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.847510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.847948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.848181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.848181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.848679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.848920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.849149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.849374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.849602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.849854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.849854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.850360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.850597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.850597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.851052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.851310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.851554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.851786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.852060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.852297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.852297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.852762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.852989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.852989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.853412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.853637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.853637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.854105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.854394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.854394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.854833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.855075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.855311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.858969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.858969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.859514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.859748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.859748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.860226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.860490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.860490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.860936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.861172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.861172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.861717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.861957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.861957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.862466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.862714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.862714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.862714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.863383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.863668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.863905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.864143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.864374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.864620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.867631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.867942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.867942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.868426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.868681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.868681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.869137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.869369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.869369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.869858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.870116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.870116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.870607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.870852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.870852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.871296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.871560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.871560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.872006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.872248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.872505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.872764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.872764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.872764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.876004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.876301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.876301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.876852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.877106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.877358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.877614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.877614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.878083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.878421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.878421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.878889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.879118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.879118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.879564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.879816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.879816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.880270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.880510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.880510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.880943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.881155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.881324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.881476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.881628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.881770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.881930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.883366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.883366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.883838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.884083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.884083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.884550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.884792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.884792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.885267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.889022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.889022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.889539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.889778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.889778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.890270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.890548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.890548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.891023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.891261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.891512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.891758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.891758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.892262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.892554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.892554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.893072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.893311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.893311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.893775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.894001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.894001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.894488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.894729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.894729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.895209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.895447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.895671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.895909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.895909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.896377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.896644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.896954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.897192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.897192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.897628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.897866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.898123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.901495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.901495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.902015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.902280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.902280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.902761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.903005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.903005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.903438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.903677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.903677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.904125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.904371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.904371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.904826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.905063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.905063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.905526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.905766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.906059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.906367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.906607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.906837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.906837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.907301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.908484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.908484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.909095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.909363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.909363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.909814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.910136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.912701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.912963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.912963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.913438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.913705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.913705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.914226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.914487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.914487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.914487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.915173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.915402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.915402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.915837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.916071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.916071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.916659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.916905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.917158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.917403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.917640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.917889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.917889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.918351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.918569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.918569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.919257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.919490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.919490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.919932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.920173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.920429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.920842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.920842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.922255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.922492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.922724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.922977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.922977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.923422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.923668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.923895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.924138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.924138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.924610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.924826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.924826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.925266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.925501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.925755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.925998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.925998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.926484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:54:03.926701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.926701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.927064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.927262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.927262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.928693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.928964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.928964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.930431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.930696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.930696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.931845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.932420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.932731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.933008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.933008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.933484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.933693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.933693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.934941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.935341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.935604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.935841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.936050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.936050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.936461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.936668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.936867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.937063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.937063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.937540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.937761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.937963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.938180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.938180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.938557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.938781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.938781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.939188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.939393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.939393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.939793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.939999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.940318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.941545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.941545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.943884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.944100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.944100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.944498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.944701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.944912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.945127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.945127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.945549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.945769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.945987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.946308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.946308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.946695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.946899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.946899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.947268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.947478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.947478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.947879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.948076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.948076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.948454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.948647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.948647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.949841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.950406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.950598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.950789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.951001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.951001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.951443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.951950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.951950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.953185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.954291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.954291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.954677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.954873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.954873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.957119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.957348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.957576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.957784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.958029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.958298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.958298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.958298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.959581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.959809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.959809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.960227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.960436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.960436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.960853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.961070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.961277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.961621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.961621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.963213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.963427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.963427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.963825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.964041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.964041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.964440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.964660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.964660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.965909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.966310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.966601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.966817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.966817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.967196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.968328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.968328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.968770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.968993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.969966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.970554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.970858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.970858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.971479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.974861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.977398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.980367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.980580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.980580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.980580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.981172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.981379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.981379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.981908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.982107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.982107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.982107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.982107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.982107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.983103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.984462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.987920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.988205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.988205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.988671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.988880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.989100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.989314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.989529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.989758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.989979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.990206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.990206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.990605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.990812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.990812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.991230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.991230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.991621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.991621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.992018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.992229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.992433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.992648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.992648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.993793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.994627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.995572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.995788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.995788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.996191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.996399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.996399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.996791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.997323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.997323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.997717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.997917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:03.997917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.000971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.001450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.001661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.001868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.002096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.002314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.002512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.002717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.002918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.004071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.004071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.004444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.004444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.004803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.005893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.006054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.006234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.006234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.007587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.007734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.007864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.008807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.009276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.011733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.012518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.013537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.016674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.017399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_db.sqlalchemy.engines [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.018368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.019789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.020454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.021991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.023661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.024500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.025321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.026486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.027878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.028498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.029957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.030194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.030508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.030835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.031234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.031553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.031872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.032214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.034247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.035179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.035179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.035179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.035807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.035993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.036311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.036624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.036939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.037261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.037571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.037885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.038229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.038553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.038859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.039214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.039533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.039900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.040219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.040540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.040871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.041194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.041519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.041841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.042193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.042537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.042871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.043199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.044131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.044131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.044131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.044580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.044800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.045044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.045371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.045712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.046026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.046365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.047165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.048336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.048662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.048987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.049316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.049637 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.049959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.050411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.050635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.050959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.051400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.051723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.052038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.052427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.052747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.053064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.053399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.054332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.054332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.054670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.054892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.055264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.055774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.055972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.056206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.056531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.056857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.057036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.context [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27f0e8c4-5c31-4fe0-8e0a-0f5398eec656(cell1) {{(pid=115910) load_cells /opt/stack/nova/nova/context.py:464}} Nov 10 15:54:04.057313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.057502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.057941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.058303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.058626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.058948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.059263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.059578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.059899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.060240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.060560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.060871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.061179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.061509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.061825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.061981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:04.062700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.063248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.063578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.063896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.064658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:04.064902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.064902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.064902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.065472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.065623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:04.065779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.065928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.066175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.066509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.066831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.067165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.067509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.067836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.068161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.068531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.068873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.069206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.069529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.069860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.070329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.070561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:04.070817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.071036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.071294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.071631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.071955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.072260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.072576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.072892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.073209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.073545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.073857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.074196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.074520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.074836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.075150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.075471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.075791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.076101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.076431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.076757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.077084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.077421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.077736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.078091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.078626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.079206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.079623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.079623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.079993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.080330 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.080742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.081134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.081476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.081795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.082138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.082496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.082827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.083149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.083482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.083856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.084100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.084413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.084726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.085039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.085349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.085665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.085982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.086315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.086488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_db.sqlalchemy.engines [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.086703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.086949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.087270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.087625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.087913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.088225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.088530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.088842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.089194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.089504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.089844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.090285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.090553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.090859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.091176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.091507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.091838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.092161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.092481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.092805 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.093135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.093509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.093844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.094242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.094517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_db.sqlalchemy.engines [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.094742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.094949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.095198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.095754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.096088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.100295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.103869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.105820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.107705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.110580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.111874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.112773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.112773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.112773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.113399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.113399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.113748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.114015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.114377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.114666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.114983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.115569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.115926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.116248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.116589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.116921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.117244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.117556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.117898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.118242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.118558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.118926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.119244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.119562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.119946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.120215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.120492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.120761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.121069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.121668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.121668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.122354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.122354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.122828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.123067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.123329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.123562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.124008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.124274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.124518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.125177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.125531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.126000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.126356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.126679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.127050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.127368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.127711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.128032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.128346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.128676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.128995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.129327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.129649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.129971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.130362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.130690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.131291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.131911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.132373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.132373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.132836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.133075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.133320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.133570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.133886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.134764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.134764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.135059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.135201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.135450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.135767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.136083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.136401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.136717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.137069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.137396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.137722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.138051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.138401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.138721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.139039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.139355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.139672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.139997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.140864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.140864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.141188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.141822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.142150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.142150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.142150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.142150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.144598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.145163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.145647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.146247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.146676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.147099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.147528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.147943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.148356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.148744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.149220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.149614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.150004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.150449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.150843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.151240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.151636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.152046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.152502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.152968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.153430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.153886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.154380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.154832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.155331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.155760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.156368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.156973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.157326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.157745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.158205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.158612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.159065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.159521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.159897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.160284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.160964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.161329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.161713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.162075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.162599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.163060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.163521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.163984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.164438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.164916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.165408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.165885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.166466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.166930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.167379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.167845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.168310 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.168741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.169159 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.169657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:54:04.170003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:54:04.194710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_db.sqlalchemy.engines [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.273721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.context [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27f0e8c4-5c31-4fe0-8e0a-0f5398eec656(cell1) {{(pid=115911) load_cells /opt/stack/nova/nova/context.py:464}} Nov 10 15:54:04.278081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:04.280013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:04.280941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:04.283124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:04.295298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_db.sqlalchemy.engines [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.296388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_db.sqlalchemy.engines [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.379420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_db.sqlalchemy.engines [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.580721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_db.sqlalchemy.engines [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:54:04.720177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: WARNING keystonemiddleware.auth_token [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:54:04.728092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: WARNING keystonemiddleware.auth_token [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:54:05.060579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: WARNING keystonemiddleware.auth_token [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:54:05.068314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: WARNING keystonemiddleware.auth_token [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:54:05.224834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: WARNING keystonemiddleware.auth_token [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:54:05.237647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: WARNING keystonemiddleware.auth_token [None req-362bc231-0509-46ff-8a68-62f74cede230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:54:05.249682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a5b960a9c0 pid: 115910 (default app) Nov 10 15:54:05.441938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: WARNING keystonemiddleware.auth_token [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 10 15:54:05.447472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: WARNING keystonemiddleware.auth_token [None req-1899d051-8b88-4419-bec7-45b77bfee525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 10 15:54:05.453338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a5b960a9c0 pid: 115911 (default app) Nov 10 15:54:39.908270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e1376618-6e68-45c1-9cdb-7395a80971f5 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Action: 'create', calling method: .version_select at 0x7faaa9d331f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2000626590"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:40.653246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-124e9d9f-58ee-4473-a1d0-8945f473fa19 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Action: 'create', calling method: .version_select at 0x7faaa9d35280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-476651526", "metadata": {"Type": "work"}}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:41.371790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e1376618-6e68-45c1-9cdb-7395a80971f5 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.734703 Nov 10 15:54:41.375355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1154 bytes} [Wed Nov 10 15:54:38 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2739 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 10 15:54:41.648606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c1d4162c-dc27-49c0-86d0-9b1433af075d tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Action: 'create', calling method: .version_select at 0x7faaa9d33dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-506171922", "metadata": {"Type": "work"}}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:41.650122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c1d4162c-dc27-49c0-86d0-9b1433af075d tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:41.662310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c1d4162c-dc27-49c0-86d0-9b1433af075d tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.285372 Nov 10 15:54:41.663023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:54:41 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 10 15:54:41.676165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ee54537-b19e-41d2-91fe-5ac2b6947ef2 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaaa56c940>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:41.833195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ee54537-b19e-41d2-91fe-5ac2b6947ef2 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 200 len: 345 microversion: 2.1 time: 0.164681 Nov 10 15:54:41.834915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 3/3] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:41 2021] GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:41.841255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-79be76c1-4981-4600-b9d5-03897e6d5fa5 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Action: 'create', calling method: .version_select at 0x7faaa9b8a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-722323138", "metadata": {"Type": "work"}}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:41.846821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-79be76c1-4981-4600-b9d5-03897e6d5fa5 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:41.848175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-79be76c1-4981-4600-b9d5-03897e6d5fa5 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011256 Nov 10 15:54:41.858811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 4/4] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:54:41 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 10 15:54:41.875681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f34c271f-1df2-45ac-a994-29ed6cc86c12 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Action: 'create', calling method: .version_select at 0x7faaa9b92280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-645902817", "metadata": {"Type": "work"}}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:41.882066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f34c271f-1df2-45ac-a994-29ed6cc86c12 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:41.883408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f34c271f-1df2-45ac-a994-29ed6cc86c12 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023034 Nov 10 15:54:41.885362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 5/5] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:54:41 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 10 15:54:41.910837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32a02377-b9b0-43ba-bee3-ecc7361d1382 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Calling method '.version_select at 0x7faaa9b8aa60>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:41.932071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-124e9d9f-58ee-4473-a1d0-8945f473fa19 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.552478 Nov 10 15:54:41.932871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1/6] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:54:39 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2555 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 10 15:54:41.959705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ce7c3305-2a6a-42a3-acb8-a505c2884a47 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9bf8e50>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:41.965475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-32a02377-b9b0-43ba-bee3-ecc7361d1382 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] HTTP exception thrown: Volume tempest-invalid-1995554544 could not be found. Nov 10 15:54:41.966142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32a02377-b9b0-43ba-bee3-ecc7361d1382 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 404 to user: Volume tempest-invalid-1995554544 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:41.967088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32a02377-b9b0-43ba-bee3-ecc7361d1382 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1995554544" status: 404 len: 99 microversion: 2.1 time: 0.069159 Nov 10 15:54:41.967782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 6/7] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Nov 10 15:54:41 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1995554544 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 10 15:54:41.997496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aaecd636-f9fa-47b2-863e-a6eed0c3008a tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019612 Nov 10 15:54:41.997964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Nov 10 15:54:41 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 10 15:54:42.032738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e057f9c4-b94c-454a-afeb-53875c3bc002 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016853 Nov 10 15:54:42.038481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 8/9] 10.222.0.60 () {58 vars in 1136 bytes} [Wed Nov 10 15:54:42 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 10 15:54:42.051266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9737cd86-06bc-49f7-942a-5d43a8617781 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Calling method '.version_select at 0x7faaa9b8a790>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:42.112193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ce7c3305-2a6a-42a3-acb8-a505c2884a47 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 352 microversion: 2.1 time: 0.170001 Nov 10 15:54:42.113345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 2/10] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:41 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:54:42.118826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bed4d79a-af5c-40fd-8543-e96c9a2bb9fd tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa9d35af0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:42.142890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-9737cd86-06bc-49f7-942a-5d43a8617781 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] HTTP exception thrown: Volume 01c6a95d-caaa-4da0-b49b-0867026b0035 could not be found. Nov 10 15:54:42.144199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9737cd86-06bc-49f7-942a-5d43a8617781 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 404 to user: Volume 01c6a95d-caaa-4da0-b49b-0867026b0035 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:42.144566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9737cd86-06bc-49f7-942a-5d43a8617781 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/01c6a95d-caaa-4da0-b49b-0867026b0035" status: 404 len: 109 microversion: 2.1 time: 0.098896 Nov 10 15:54:42.145586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 9/11] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 15:54:42 2021] DELETE /compute/v2.1/os-volumes/01c6a95d-caaa-4da0-b49b-0867026b0035 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:42.166694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-af2c2b45-46a5-4ff4-bf8b-0eb55bcbf997 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Calling method '.version_select at 0x7faaaa56c790>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:42.242038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bed4d79a-af5c-40fd-8543-e96c9a2bb9fd tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3a34f230-05a5-44ae-8944-21165afb6a07" status: 200 len: 350 microversion: 2.1 time: 0.127171 Nov 10 15:54:42.249835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 3/12] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:42 2021] GET /compute/v2.1/os-volumes/3a34f230-05a5-44ae-8944-21165afb6a07 => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:42.266543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-af2c2b45-46a5-4ff4-bf8b-0eb55bcbf997 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] HTTP exception thrown: Volume d678ef55-2ae8-42eb-8e5b-de6d04525063 could not be found. Nov 10 15:54:42.267412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-af2c2b45-46a5-4ff4-bf8b-0eb55bcbf997 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] Returning 404 to user: Volume d678ef55-2ae8-42eb-8e5b-de6d04525063 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:42.268483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-af2c2b45-46a5-4ff4-bf8b-0eb55bcbf997 tempest-VolumesNegativeTest-309695562 tempest-VolumesNegativeTest-309695562-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d678ef55-2ae8-42eb-8e5b-de6d04525063" status: 404 len: 109 microversion: 2.1 time: 0.115481 Nov 10 15:54:42.269343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 10/13] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:42 2021] GET /compute/v2.1/os-volumes/d678ef55-2ae8-42eb-8e5b-de6d04525063 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 10 15:54:42.415047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1435786034", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "8bc89ac5-84df-4793-bc2c-fb0a0b3c1dd4"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:42.689197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] validate_networks() for [('8bc89ac5-84df-4793-bc2c-fb0a0b3c1dd4', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:54:42.850081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fe35e24f-db08-4d0d-8ee9-8d28ca33b8b9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9b8a700>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:42.969482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fe35e24f-db08-4d0d-8ee9-8d28ca33b8b9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 200 len: 346 microversion: 2.1 time: 0.123138 Nov 10 15:54:42.975521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 11/14] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:42 2021] GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:42.985032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-490a0070-9ec1-40a0-bb0a-21a2dd9f8470 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Action: 'create', calling method: .version_select at 0x7faaa9b92d30>, body: {"snapshot": {"volume_id": "1871582c-0c4b-4b9c-a7fb-426bc1103191", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1017654280"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:43.430882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-490a0070-9ec1-40a0-bb0a-21a2dd9f8470 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.449417 Nov 10 15:54:43.444145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 12/15] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Nov 10 15:54:42 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:43.444145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-13c8d2f3-d8dd-4f03-9be0-4f6e91c7272c tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaaa56c820>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:43.572590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-13c8d2f3-d8dd-4f03-9be0-4f6e91c7272c tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 353 microversion: 2.1 time: 0.134532 Nov 10 15:54:43.573435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 13/16] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:43 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:43.578523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-417d10bd-cbdc-4e9d-950f-136821fb9b5a tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9b8a940>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:43.632217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-417d10bd-cbdc-4e9d-950f-136821fb9b5a tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 200 len: 287 microversion: 2.1 time: 0.056985 Nov 10 15:54:43.632817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 14/17] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:43 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:43.637778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0b06a32a-4bcb-4f74-8d14-dfe361cc90ae tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9b92ca0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:43.743881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0b06a32a-4bcb-4f74-8d14-dfe361cc90ae tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 353 microversion: 2.1 time: 0.109590 Nov 10 15:54:43.744672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 15/18] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:43 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:43.758792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-23e0dc16-5aa6-452a-92bd-92e725d27402 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9b8ad30>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:43.826359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-23e0dc16-5aa6-452a-92bd-92e725d27402 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.079354 Nov 10 15:54:43.827567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 16/19] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Nov 10 15:54:43 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:43.847483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f0feba24-001b-404e-be7c-f657e74673ac tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9b924c0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:43.999866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f0feba24-001b-404e-be7c-f657e74673ac tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 202 len: 0 microversion: 2.1 time: 0.171150 Nov 10 15:54:44.000513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 17/20] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 15:54:43 2021] DELETE /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:54:44.019267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-732209d9-bbaa-4189-bf0f-638dd3e3b28d tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9b92c10>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:44.091867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-732209d9-bbaa-4189-bf0f-638dd3e3b28d tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 200 len: 287 microversion: 2.1 time: 0.078220 Nov 10 15:54:44.092481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 18/21] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:44 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:44.113539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-68e0ccc1-c91f-4b96-805a-cfce3f59ae54 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9b92e50>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:44.233831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-68e0ccc1-c91f-4b96-805a-cfce3f59ae54 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 352 microversion: 2.1 time: 0.135128 Nov 10 15:54:44.253689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 19/22] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:44 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:44.262960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ccdf44b7-6c41-4702-b480-d48dc08de25d tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa9b92790>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:44.351828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ccdf44b7-6c41-4702-b480-d48dc08de25d tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0e010423-d9ae-470b-a6c1-68fb0f9677d2" status: 200 len: 351 microversion: 2.1 time: 0.097390 Nov 10 15:54:44.352674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 20/23] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:44 2021] GET /compute/v2.1/os-volumes/0e010423-d9ae-470b-a6c1-68fb0f9677d2 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:44.852369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:54:44.853042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:54:44.853299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:54:44.853663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:54:44.854259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:54:44.881088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:44.891964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:44.892997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:44.893442 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:44.961498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Getting quotas for project 957858dcc5384487a7ef337124998c1b. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:54:44.984524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Getting quotas for user 214880bcabcd45dd89753e769ca07220 and project 957858dcc5384487a7ef337124998c1b. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:54:45.022107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:54:45.025337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:54:45.104964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-01e8edee-0ed0-4b2b-96ab-f9f9f1bce82a tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9b8a670>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:45.238075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e8078f02-dd2b-4673-bf4d-15b7b358b83e tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.986955 Nov 10 15:54:45.239813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 4/24] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:54:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:54:45.256831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9674eb64-7eac-4941-80f8-b788767dcbf9 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9afe670>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:45.261089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-01e8edee-0ed0-4b2b-96ab-f9f9f1bce82a tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 200 len: 287 microversion: 2.1 time: 0.159804 Nov 10 15:54:45.268638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 21/25] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:45 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:45.276119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6e71cf68-9c98-4b35-af0a-9650fa70b252 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:45.277267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6e71cf68-9c98-4b35-af0a-9650fa70b252 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:45.349794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9674eb64-7eac-4941-80f8-b788767dcbf9 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 352 microversion: 2.1 time: 0.104031 Nov 10 15:54:45.350417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 5/26] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:45 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:45.495131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6e71cf68-9c98-4b35-af0a-9650fa70b252 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:45.571891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6e71cf68-9c98-4b35-af0a-9650fa70b252 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1215 microversion: 2.1 time: 0.300210 Nov 10 15:54:45.574736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 22/27] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:45 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:46.277124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a294fe74-7150-4f10-b4ac-11d304168134 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9afef70>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:46.331377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a294fe74-7150-4f10-b4ac-11d304168134 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 200 len: 287 microversion: 2.1 time: 0.059046 Nov 10 15:54:46.331972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 6/28] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:46 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:46.369963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa33b110-7d1f-45e1-bae0-fff0d61c15aa tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9b929d0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:46.484318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa33b110-7d1f-45e1-bae0-fff0d61c15aa tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 200 len: 352 microversion: 2.1 time: 0.123747 Nov 10 15:54:46.485619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 23/29] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:46 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:54:46.602743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fd9fe0b5-b9b7-41dd-9572-01283d8bd71f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:46.603835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fd9fe0b5-b9b7-41dd-9572-01283d8bd71f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:46.817341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fd9fe0b5-b9b7-41dd-9572-01283d8bd71f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:46.852352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fd9fe0b5-b9b7-41dd-9572-01283d8bd71f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1215 microversion: 2.1 time: 0.254270 Nov 10 15:54:46.857347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 7/30] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:46 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:47.143615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b1f748c6-8190-46e3-bdc5-549f142161ae tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa9bade50>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.287075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b1f748c6-8190-46e3-bdc5-549f142161ae tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8bdfe35-d2d4-4fde-9cf0-6c4b34a4cce8" status: 200 len: 350 microversion: 2.1 time: 0.159100 Nov 10 15:54:47.288492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 24/31] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/os-volumes/d8bdfe35-d2d4-4fde-9cf0-6c4b34a4cce8 => generated 350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:47.308503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c3f025d5-2dbc-456a-a5cf-dca37542b870 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa92ba1f0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.348984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-20b08c37-b1fe-4fa2-a352-dec20b36747d tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9badf70>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.511355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-20b08c37-b1fe-4fa2-a352-dec20b36747d tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 200 len: 288 microversion: 2.1 time: 0.169994 Nov 10 15:54:47.515346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 25/32] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:47.534270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5deed6d7-c712-4eef-9998-5f0226a744c8 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Calling method '.version_select at 0x7faaa9b929d0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.651376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-5deed6d7-c712-4eef-9998-5f0226a744c8 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] HTTP exception thrown: Volume 0be59ab8-46c0-43c0-826e-836ec7d1509f could not be found. Nov 10 15:54:47.653365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5deed6d7-c712-4eef-9998-5f0226a744c8 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] Returning 404 to user: Volume 0be59ab8-46c0-43c0-826e-836ec7d1509f could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:47.655054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5deed6d7-c712-4eef-9998-5f0226a744c8 tempest-VolumesGetTestJSON-259315414 tempest-VolumesGetTestJSON-259315414-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f" status: 404 len: 109 microversion: 2.1 time: 0.137496 Nov 10 15:54:47.656112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 26/33] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/os-volumes/0be59ab8-46c0-43c0-826e-836ec7d1509f => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:47.675373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-66bc0c8b-f0b8-4305-beea-7c5bcdeaaaf1 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9bfaee0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.834793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c3f025d5-2dbc-456a-a5cf-dca37542b870 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.537180 Nov 10 15:54:47.836799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 8/34] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:47.882319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fd6bec25-93ae-466c-8b64-e452852b0074 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa92baee0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.956645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-66bc0c8b-f0b8-4305-beea-7c5bcdeaaaf1 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 202 len: 0 microversion: 2.1 time: 0.298740 Nov 10 15:54:47.957928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 27/35] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Nov 10 15:54:47 2021] DELETE /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:54:47.966277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:47.967209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:47.985967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:47.997228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:48.000194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:48.000843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:48.253437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fd6bec25-93ae-466c-8b64-e452852b0074 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.406832 Nov 10 15:54:48.254441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 9/36] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:48.262656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e3e2e9a-4ac0-41da-b35c-30955b451cd4 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa8a51700>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:48.349080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-2e3e2e9a-4ac0-41da-b35c-30955b451cd4 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] HTTP exception thrown: Snapshot 7ed81604-7348-490d-9ce1-927262e330c1 could not be found. Nov 10 15:54:48.350081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e3e2e9a-4ac0-41da-b35c-30955b451cd4 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Returning 404 to user: Snapshot 7ed81604-7348-490d-9ce1-927262e330c1 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:48.351692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e3e2e9a-4ac0-41da-b35c-30955b451cd4 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1" status: 404 len: 111 microversion: 2.1 time: 0.095679 Nov 10 15:54:48.352703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 10/37] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Nov 10 15:54:48 2021] GET /compute/v2.1/os-snapshots/7ed81604-7348-490d-9ce1-927262e330c1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:48.380759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e2416e54-862d-4ff9-9b62-4bcc8ac3313c tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa8a519d0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:48.701928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e2416e54-862d-4ff9-9b62-4bcc8ac3313c tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.338098 Nov 10 15:54:48.705730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 11/38] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Nov 10 15:54:48 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:48.715094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-86d1a3f7-047d-4fa0-abbd-503b44c90ae3 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa92ba0d0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:48.866309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-86d1a3f7-047d-4fa0-abbd-503b44c90ae3 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 202 len: 0 microversion: 2.1 time: 0.159239 Nov 10 15:54:48.867566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 12/39] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 15:54:48 2021] DELETE /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:54:48.874690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-087e978e-0034-4852-87e7-43db639715e9 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaaa576670>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:48.885083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:48.926336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac051416-111b-4bbd-8bbe-6defc49eabcd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1219 microversion: 2.1 time: 0.966027 Nov 10 15:54:48.938787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 28/40] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:47 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1219 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:48.963868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9d41bc33-4ace-4e96-bca7-405973d43c92 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9ae25e0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.102182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-9d41bc33-4ace-4e96-bca7-405973d43c92 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] HTTP exception thrown: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. Nov 10 15:54:49.104124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9d41bc33-4ace-4e96-bca7-405973d43c92 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Returning 404 to user: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:49.106122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9d41bc33-4ace-4e96-bca7-405973d43c92 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 404 len: 109 microversion: 2.1 time: 0.165679 Nov 10 15:54:49.111349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 29/41] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:48 2021] GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:49.144556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d89b2930-d41f-4710-8238-5e335cf362af tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9aeb820>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.205045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-087e978e-0034-4852-87e7-43db639715e9 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.335039 Nov 10 15:54:49.206700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 13/42] 10.222.0.60 () {58 vars in 1166 bytes} [Wed Nov 10 15:54:48 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:49.232535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a6e0721c-392d-4338-bfbe-d4d23023af4e tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa8a514c0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.263896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-d89b2930-d41f-4710-8238-5e335cf362af tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] HTTP exception thrown: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. Nov 10 15:54:49.264918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d89b2930-d41f-4710-8238-5e335cf362af tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Returning 404 to user: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:49.269051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d89b2930-d41f-4710-8238-5e335cf362af tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 404 len: 109 microversion: 2.1 time: 0.144101 Nov 10 15:54:49.270474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 30/43] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 15:54:49 2021] DELETE /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:49.320143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e6a15143-63f6-41bc-b526-5a28fd7568d9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Calling method '.version_select at 0x7faaa9ae21f0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.408443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-e6a15143-63f6-41bc-b526-5a28fd7568d9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] HTTP exception thrown: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. Nov 10 15:54:49.409063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e6a15143-63f6-41bc-b526-5a28fd7568d9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] Returning 404 to user: Volume 1871582c-0c4b-4b9c-a7fb-426bc1103191 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:54:49.410564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e6a15143-63f6-41bc-b526-5a28fd7568d9 tempest-VolumesSnapshotsTestJSON-431201833 tempest-VolumesSnapshotsTestJSON-431201833-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191" status: 404 len: 109 microversion: 2.1 time: 0.129623 Nov 10 15:54:49.411167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 31/44] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/os-volumes/1871582c-0c4b-4b9c-a7fb-426bc1103191 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 10 15:54:49.446112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a6e0721c-392d-4338-bfbe-d4d23023af4e tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.227119 Nov 10 15:54:49.446966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 14/45] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:49.465610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-29dc4dfc-4916-4fe8-8069-b8a73f9ef721 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaaf29c0d0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.660772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-29dc4dfc-4916-4fe8-8069-b8a73f9ef721 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.201531 Nov 10 15:54:49.673936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b42b2602-d612-4672-9104-c5e6f8202fa7 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa8a57b80>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.677148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 32/46] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:49.950312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:49.952393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:49.973548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b42b2602-d612-4672-9104-c5e6f8202fa7 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.303058 Nov 10 15:54:49.985375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 15/47] 10.222.0.60 () {58 vars in 1187 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:54:49.997066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ddfe8712-8100-4630-b0c7-55a49b1c6e52 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] Calling method '.version_select at 0x7faaa8a578b0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:50.007296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:50.010647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:50.017959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:50.022086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:50.444592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:50.456082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3298632e-720f-4443-b808-351d1b4cc798 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1273 microversion: 2.1 time: 0.514354 Nov 10 15:54:50.460863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 33/48] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1273 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:50.592428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ddfe8712-8100-4630-b0c7-55a49b1c6e52 tempest-VolumesTestJSON-1948277203 tempest-VolumesTestJSON-1948277203-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.605023 Nov 10 15:54:50.594502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 16/49] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Nov 10 15:54:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:51.484900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:51.487894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:51.499322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:51.500413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:51.502100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:51.503199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:52.176916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:52.195475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-936efe22-a5eb-4622-aa3e-710dcff549f7 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1273 microversion: 2.1 time: 0.719045 Nov 10 15:54:52.212171 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 34/50] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:51 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1273 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:53.250764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:53.272459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:53.353316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:53.357834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:53.360148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:53.364303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:55.049643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:55.132758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e28afc6f-a082-4bdc-85c2-d8e7a00b0c88 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.906410 Nov 10 15:54:55.145959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 17/51] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:53 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:56.165881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:56.166927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:56.177537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:56.180801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:56.182219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:56.183602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:56.617563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:54:56.633439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-68085e86-054c-4821-8ab3-860e6dd2d2d0 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 0.472322 Nov 10 15:54:56.634968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 18/52] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:56 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:54:56.931590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'create', calling method: .version_select at 0x7faaa9aeb670>, body: {"keypair": {"name": "tempest-keypair-1455674392"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:57.044656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:54:57.077295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:54:57.377843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-855249468", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b2acddc-81ed-40f6-ae5f-ee2f9d427873"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:54:57.520689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] validate_networks() for [('3b2acddc-81ed-40f6-ae5f-ee2f9d427873', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:54:58.964219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:54:58.974743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:54:59.021024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-da003485-a433-4f90-808f-2b8bbcdf95fa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 3.624740 Nov 10 15:54:59.024104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 35/53] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Nov 10 15:54:55 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 3628 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 10 15:54:59.031455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:54:59.032093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:54:59.061908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:59.062397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:59.063212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:59.063652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:59.657847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:54:59.658436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:54:59.658747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:54:59.659156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:54:59.659907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:54:59.685801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:59.686303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:59.687291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:54:59.687959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:54:59.785338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Getting quotas for project f5c60a77a9e14defb1cbca4e34871865. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:54:59.814136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Getting quotas for user ed271ee2a33f484ebb184fd30f99281b and project f5c60a77a9e14defb1cbca4e34871865. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:54:59.902216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:54:59.919728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:55:00.130552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-46a7ea8b-8776-484b-afcc-0cabf1da7797 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.310160 Nov 10 15:55:00.137684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 19/54] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:54:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 10 15:55:00.161353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-857308b6-4c50-49b6-9118-dbb033b53d9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:00.168190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-857308b6-4c50-49b6-9118-dbb033b53d9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:01.118115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-857308b6-4c50-49b6-9118-dbb033b53d9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:01.130976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-857308b6-4c50-49b6-9118-dbb033b53d9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1221 microversion: 2.1 time: 0.986742 Nov 10 15:55:01.131981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 20/55] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1221 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:01.423043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:01.435435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1f223c6f-3f76-4a07-a773-15e10f50e78a tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 2.409125 Nov 10 15:55:01.443226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 36/56] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:54:59 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:01.977019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-535221922", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b2acddc-81ed-40f6-ae5f-ee2f9d427873"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:02.199791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] validate_networks() for [('3b2acddc-81ed-40f6-ae5f-ee2f9d427873', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:55:03.223054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-b5cab62d-cf12-4f6a-94df-7450d3f7786e req-130879f6-b6aa-449d-b97e-52dcb817ec78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92cbc0f-22cf-403b-8756-c1a1e45cb7aa", "tag": "1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:03.227163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:03.227163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:55:03.264725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b5cab62d-cf12-4f6a-94df-7450d3f7786e req-130879f6-b6aa-449d-b97e-52dcb817ec78 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.264725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b5cab62d-cf12-4f6a-94df-7450d3f7786e req-130879f6-b6aa-449d-b97e-52dcb817ec78 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.298244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:55:03.302416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:55:03.303306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:55:03.303833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:55:03.304322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:55:03.316226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-b5cab62d-cf12-4f6a-94df-7450d3f7786e req-130879f6-b6aa-449d-b97e-52dcb817ec78 service nova] Creating event network-changed:1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f for instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa on hv-cinder-81708 Nov 10 15:55:03.319661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b5cab62d-cf12-4f6a-94df-7450d3f7786e req-130879f6-b6aa-449d-b97e-52dcb817ec78 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 10 15:55:03.325784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.327918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.329839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.330343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.330901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.331178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.331614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.332225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.397198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.compute.rpcapi [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 10 15:55:03.411549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] Releasing lock "compute-rpcapi-router" {{(pid=115910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 10 15:55:03.458430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Getting quotas for project f5c60a77a9e14defb1cbca4e34871865. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:55:03.480353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Getting quotas for user ed271ee2a33f484ebb184fd30f99281b and project f5c60a77a9e14defb1cbca4e34871865. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:55:03.536820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:55:03.539666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:55:03.543264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f7e8460e-97d0-4411-aba0-fa67b0284061 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.164534 Nov 10 15:55:03.549840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 37/57] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:03.565524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:03.567635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:03.588547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.590388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.592335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:03.598254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:03.709973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-08b2dbbf-7674-407d-bd6b-363db6691fc3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.749587 Nov 10 15:55:03.725577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 21/58] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:55:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:55:03.743305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-50c7b7e3-53da-4bc1-a824-d1ac709a13d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:03.744246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-50c7b7e3-53da-4bc1-a824-d1ac709a13d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:04.308842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-50c7b7e3-53da-4bc1-a824-d1ac709a13d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:04.320772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-50c7b7e3-53da-4bc1-a824-d1ac709a13d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1221 microversion: 2.1 time: 0.588080 Nov 10 15:55:04.325928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 22/59] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:03 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1221 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:04.737095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:04.762605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61c0ae29-1c20-4747-a4c5-be65d5322f24 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.210698 Nov 10 15:55:04.790797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 38/60] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:03 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:05.348431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:05.350843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:05.372048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:05.374028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:05.376680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:05.379239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:05.793085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:05.796094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:05.809970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:05.815395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:05.816770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:05.817807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:05.832856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:05.856466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f8d45d15-b969-4dea-82d5-08853d2c4f2b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1225 microversion: 2.1 time: 0.503353 Nov 10 15:55:05.874286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 23/61] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:05 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1225 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:06.880307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:06.881202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:06.890560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:06.898602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:06.900115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:06.900784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:06.982993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:06.994058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-db0dae4b-d6f4-4f3a-a59a-1091e1171959 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.204748 Nov 10 15:55:06.999573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 39/62] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:05 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:07.171815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:07.188399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c6afd96b-140d-4d98-8e7d-c3f3bb035042 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1273 microversion: 2.1 time: 0.312032 Nov 10 15:55:07.197037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 24/63] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:06 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:07.983066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-585681353", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b316940-2ac2-4ffe-a852-6ca7feb591f2"}], "security_groups": [{"name": "tempest-securitygroup--441178114"}], "key_name": "tempest-keypair-1455674392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:08.027893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:08.028519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:08.046892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:08.048438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:08.054499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:08.056668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:08.284121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] validate_networks() for [('4b316940-2ac2-4ffe-a852-6ca7feb591f2', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:55:09.131449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:09.143766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fb31fb08-322b-48e4-ad3b-3d454a449ebd tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.119367 Nov 10 15:55:09.144107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 25/64] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:08 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:09.157048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:09.164223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:09.186914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:09.187347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:09.201430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:09.201891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:09.537946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:09.556803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4eeee378-6eda-41a7-b3ba-c92d3fe821f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1279 microversion: 2.1 time: 0.411176 Nov 10 15:55:09.559459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 26/65] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:09 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1279 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:09.785445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-5e7a6d4e-1527-4fc9-a145-1b8e7f3da43e req-79ad4942-e1b8-4fe0-a82e-5a8d3df1b434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f732db3a-a74d-4503-8538-9bcb4136479a", "tag": "f1350101-b68f-49c3-a23d-a1b73c5ad182"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:09.788759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:09.788759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:09.812516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-5e7a6d4e-1527-4fc9-a145-1b8e7f3da43e req-79ad4942-e1b8-4fe0-a82e-5a8d3df1b434 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:09.813046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-5e7a6d4e-1527-4fc9-a145-1b8e7f3da43e req-79ad4942-e1b8-4fe0-a82e-5a8d3df1b434 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:09.849195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-5e7a6d4e-1527-4fc9-a145-1b8e7f3da43e req-79ad4942-e1b8-4fe0-a82e-5a8d3df1b434 service nova] Creating event network-changed:f1350101-b68f-49c3-a23d-a1b73c5ad182 for instance f732db3a-a74d-4503-8538-9bcb4136479a on hv-cinder-81708 Nov 10 15:55:09.850002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-5e7a6d4e-1527-4fc9-a145-1b8e7f3da43e req-79ad4942-e1b8-4fe0-a82e-5a8d3df1b434 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115911) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 10 15:55:09.851349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:09.851953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:09.853005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:09.853636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:09.869758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.compute.rpcapi [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 10 15:55:09.871087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] Releasing lock "compute-rpcapi-router" {{(pid=115911) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 10 15:55:09.905472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-90b79272-d90d-4e3b-acb8-4a918b106bc6 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126795 Nov 10 15:55:09.906456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 27/66] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:55:10.177845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:10.180299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:10.191489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.192537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.194472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.195644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.519682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:55:10.520189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:55:10.521917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:55:10.522065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:55:10.522511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:55:10.569471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.573368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.574446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.575060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.591613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:10.605728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-150aa079-a473-42b6-b55e-117fc437a831 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 0.435260 Nov 10 15:55:10.608078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 28/67] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:10 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:10.615486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:10.616875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:10.638407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.639137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.640417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:10.644353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:55:10.646075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:10.653470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:55:10.689972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:55:10.705991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:55:10.861437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-54a20e38-f3c5-416b-9958-8de776cde87b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.882884 Nov 10 15:55:10.862465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 40/68] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Nov 10 15:55:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 2885 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 10 15:55:10.873908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:10.874827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:11.090601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:11.100089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:11.102739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:11.108322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a46a60ce-915f-40c2-ad89-55d278064f57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1281 microversion: 2.20 time: 0.234816 Nov 10 15:55:11.109107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 41/69] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:11.338964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:11.349330 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b5aae8aa-9ea0-42b0-8104-7433c8c1ff02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 0.738301 Nov 10 15:55:11.359142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 29/70] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:10 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:11.627762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:11.629035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:11.654902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:11.655936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:11.659505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:11.675597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:12.129333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:12.130130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:12.139491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:12.143545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:12.148582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:12.150059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:12.298044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:12.310781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:12.316164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:12.323900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-185827c2-ab2d-40a6-b28b-1b8f44937cb5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1333 microversion: 2.20 time: 0.199010 Nov 10 15:55:12.330929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 30/71] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1333 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:55:12.374011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:12.375997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:12.405606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:12.406689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:12.407788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:12.409638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:13.149533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:13.161322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fb355133-83ef-4036-b000-cf89a513ff4d tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.536755 Nov 10 15:55:13.171454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 42/72] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:11 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:13.246203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:13.259988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1ebdac0e-0745-4db4-9a78-11596163bf6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 0.896496 Nov 10 15:55:13.260588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 31/73] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:12 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:13.360675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:13.361489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:13.371160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:13.377921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:13.379262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:13.379728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:13.477004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:13.490798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:13.495687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:13.499760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f425f6d9-fa4b-4982-817e-7dbf2f1d288d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1339 microversion: 2.20 time: 0.143611 Nov 10 15:55:13.502584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 43/74] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:14.179214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:14.179825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:14.186981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:14.201647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:14.204290 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:14.212152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:14.278849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:14.279550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:14.300265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:14.300713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:14.301527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:14.301963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:15.235047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:15.253646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5008a533-fe6d-4944-9730-f6b61e2942ca tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.075043 Nov 10 15:55:15.256897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 32/75] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:14 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:15.266900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:15.275510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c74b3908-d9b3-451d-ad93-d9725f71e286 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 1.000849 Nov 10 15:55:15.282512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 44/76] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:14 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:15.299036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:15.299950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:15.309518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:15.310264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:15.311291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:15.312024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:15.636035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:15.646127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:15.653643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:15.657848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-21e1fc26-6dcb-4f61-9bf3-0327a403215a req-93e9c154-1212-4e0e-9484-3dda82677810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db7e16c-41b1-448e-bb30-c71d98091b75", "tag": "a9c26607-bfdd-42a8-90aa-11acb5442ba8"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:15.660098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:15.660098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:15.668770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3a1fc893-5d06-4654-b779-92f4a5c08fdf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.384388 Nov 10 15:55:15.675506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-21e1fc26-6dcb-4f61-9bf3-0327a403215a req-93e9c154-1212-4e0e-9484-3dda82677810 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:15.676186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-21e1fc26-6dcb-4f61-9bf3-0327a403215a req-93e9c154-1212-4e0e-9484-3dda82677810 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:15.682985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 45/77] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:15 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:15.700564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-21e1fc26-6dcb-4f61-9bf3-0327a403215a req-93e9c154-1212-4e0e-9484-3dda82677810 service nova] Creating event network-changed:a9c26607-bfdd-42a8-90aa-11acb5442ba8 for instance 6db7e16c-41b1-448e-bb30-c71d98091b75 on hv-cinder-81708 Nov 10 15:55:15.721115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-21e1fc26-6dcb-4f61-9bf3-0327a403215a req-93e9c154-1212-4e0e-9484-3dda82677810 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461283 Nov 10 15:55:15.722392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 33/78] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:15.814628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-a0b63209-85d9-40dc-937d-eceea8312798 req-a734a828-bf1e-4372-b37e-8056ebd8c988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92cbc0f-22cf-403b-8756-c1a1e45cb7aa", "name": "network-vif-plugged", "status": "completed", "tag": "1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:15.817457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:15.817457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:55:15.835032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a0b63209-85d9-40dc-937d-eceea8312798 req-a734a828-bf1e-4372-b37e-8056ebd8c988 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:15.839644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a0b63209-85d9-40dc-937d-eceea8312798 req-a734a828-bf1e-4372-b37e-8056ebd8c988 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:15.871668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-a0b63209-85d9-40dc-937d-eceea8312798 req-a734a828-bf1e-4372-b37e-8056ebd8c988 service nova] Creating event network-vif-plugged:1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f for instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa on hv-cinder-81708 Nov 10 15:55:15.882923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-a0b63209-85d9-40dc-937d-eceea8312798 req-a734a828-bf1e-4372-b37e-8056ebd8c988 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194263 Nov 10 15:55:15.884371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 46/79] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:16.018266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-4ac0b889-fa16-409a-89ea-b552ddbe2706 req-95d51fbf-f8de-4094-8222-0766bec46c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:16.025218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:16.025218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:16.055666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-4ac0b889-fa16-409a-89ea-b552ddbe2706 req-95d51fbf-f8de-4094-8222-0766bec46c3f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:16.060221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-4ac0b889-fa16-409a-89ea-b552ddbe2706 req-95d51fbf-f8de-4094-8222-0766bec46c3f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:16.118240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-4ac0b889-fa16-409a-89ea-b552ddbe2706 req-95d51fbf-f8de-4094-8222-0766bec46c3f service nova] Creating event network-changed:d1fb9f0b-735b-4033-978f-e1637c0ce284 for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa on hv-cinder-81708 Nov 10 15:55:16.135670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-4ac0b889-fa16-409a-89ea-b552ddbe2706 req-95d51fbf-f8de-4094-8222-0766bec46c3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129023 Nov 10 15:55:16.136336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 34/80] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:16.277675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:16.278461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:16.296393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:16.297936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:16.300457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:16.301012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:16.303211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:16.304023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:16.319936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:16.321134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:16.325864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:16.327086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:17.266852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:17.289775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:17.315352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3a99369-1593-48b6-b1a6-43b28ab0b4a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 1.018919 Nov 10 15:55:17.319444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 35/81] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:16 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:17.334451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-db591a10-d99e-46e2-a4b0-bcd6ef43eb9f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 1.065988 Nov 10 15:55:17.335309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 47/82] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:16 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:17.348786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:17.349447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:17.365836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:17.366327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:17.367148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:17.367585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:17.611229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:17.620356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:17.622060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:17.623434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-45f40ccb-72e7-4153-ab98-25b6f987a27c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.287580 Nov 10 15:55:17.634837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 36/83] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:18.231979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-5ab3c527-be5b-4196-b65a-f1c1516e8dab req-eb00163a-f37e-4467-8252-65acd93d0290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f732db3a-a74d-4503-8538-9bcb4136479a", "name": "network-vif-plugged", "status": "completed", "tag": "f1350101-b68f-49c3-a23d-a1b73c5ad182"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:18.234629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:18.234629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:55:18.268961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-5ab3c527-be5b-4196-b65a-f1c1516e8dab req-eb00163a-f37e-4467-8252-65acd93d0290 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.269482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-5ab3c527-be5b-4196-b65a-f1c1516e8dab req-eb00163a-f37e-4467-8252-65acd93d0290 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.312726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-5ab3c527-be5b-4196-b65a-f1c1516e8dab req-eb00163a-f37e-4467-8252-65acd93d0290 service nova] Creating event network-vif-plugged:f1350101-b68f-49c3-a23d-a1b73c5ad182 for instance f732db3a-a74d-4503-8538-9bcb4136479a on hv-cinder-81708 Nov 10 15:55:18.321374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-5ab3c527-be5b-4196-b65a-f1c1516e8dab req-eb00163a-f37e-4467-8252-65acd93d0290 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093124 Nov 10 15:55:18.322963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 48/84] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:18.341630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:18.353811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:18.372509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.374461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.378450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.379338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:18.380445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.382427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:18.463520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.468538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.471387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.473407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.893423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:18.902254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0e8b0ffb-182a-4963-9818-eaf9a2ee417a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 0.564986 Nov 10 15:55:18.906121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 37/85] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:18 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:18.918717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:18.919611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:18.940335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.941018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:18.943974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:18.944621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:19.048023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:19.058152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1caa0a6d-2caf-4632-9f91-676dcdcbc34f tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1315 microversion: 2.1 time: 0.695341 Nov 10 15:55:19.058902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 49/86] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:18 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:19.168030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:19.177039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:19.178814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:19.180134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-352c4e44-9eb3-4b71-9b2d-a06b20d5db86 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.272658 Nov 10 15:55:19.180686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 38/87] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:19.934689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:19.936108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:19.952133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:19.952994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:19.954053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:19.954676 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.092721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:20.095360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:20.125546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:20.126446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.127671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:20.128310 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.212964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:20.222953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-736517ed-4f86-4b22-9008-7c5f1104f9d5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 0.292616 Nov 10 15:55:20.241696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 50/88] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:19 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:20.254295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:20.255156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:20.269052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:20.270006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.274540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:20.275097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.635198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:20.646073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c52e49fb-e116-48d5-a13c-b4be7ed480ba tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1501 microversion: 2.1 time: 0.571741 Nov 10 15:55:20.659959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 39/89] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:20 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1501 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:20.686530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-365e8a82-4994-4bf1-8a4d-a0e36be66a07 req-f6947771-16e9-4d17-ba00-c3bc67611057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db7e16c-41b1-448e-bb30-c71d98091b75", "name": "network-vif-plugged", "status": "completed", "tag": "a9c26607-bfdd-42a8-90aa-11acb5442ba8"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:20.688747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:20.688747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:20.707810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-365e8a82-4994-4bf1-8a4d-a0e36be66a07 req-f6947771-16e9-4d17-ba00-c3bc67611057 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:20.709652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-365e8a82-4994-4bf1-8a4d-a0e36be66a07 req-f6947771-16e9-4d17-ba00-c3bc67611057 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:20.730511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-365e8a82-4994-4bf1-8a4d-a0e36be66a07 req-f6947771-16e9-4d17-ba00-c3bc67611057 service nova] Creating event network-vif-plugged:a9c26607-bfdd-42a8-90aa-11acb5442ba8 for instance 6db7e16c-41b1-448e-bb30-c71d98091b75 on hv-cinder-81708 Nov 10 15:55:20.746733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:20.753139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-365e8a82-4994-4bf1-8a4d-a0e36be66a07 req-f6947771-16e9-4d17-ba00-c3bc67611057 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100910 Nov 10 15:55:20.761927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 40/90] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:20.767631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:20.772431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:20.778238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e89c8ffb-af67-4512-b2f4-c6e0e7f7c1d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.531784 Nov 10 15:55:20.779515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 51/91] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:21.250285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:21.252292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:21.268693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:21.269617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:21.272753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:21.274376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:21.802070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:21.802968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:21.812810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:21.814801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:21.815873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:21.829101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:21.933393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:21.957583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5ceea786-2df5-41a2-87cb-1f01b65e4474 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1321 microversion: 2.1 time: 0.712445 Nov 10 15:55:21.963853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 41/92] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:21 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:22.204670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:22.216667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:22.219267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:22.220816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2d7ba46-f5e6-47c3-a8c4-d39b30126142 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.423584 Nov 10 15:55:22.221895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 52/93] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:21 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:55:22.530050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3397ee7-f954-435b-be5b-3892c34c5a1b"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:22.531522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:22.547286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:22.547719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:22.548506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:22.549140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:22.991716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:22.992353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:23.000707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.005196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.008129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.012531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.298583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dc82e2f9-94ad-4f49-9edc-49d6340f0405 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "POST /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772488 Nov 10 15:55:23.299898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 42/94] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:55:22 2021] POST /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:23.309896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:23.313092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:23.343366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:23.344726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.345118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.345940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.346404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.353809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a420359f-5eb4-4b06-885c-8bdabe1b8d7d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1514 microversion: 2.1 time: 0.365733 Nov 10 15:55:23.355294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 53/95] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:22 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:23.380965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:23.387566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:23.400261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.401915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.403685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.405290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.509448 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lazy-loading 'flavor' on Instance uuid 6db7e16c-41b1-448e-bb30-c71d98091b75 {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:55:23.731191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75b5fc80-73ce-4213-8a3a-d296dfcac0b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75/action" status: 200 len: 32 microversion: 2.1 time: 0.354200 Nov 10 15:55:23.734582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 54/96] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 15:55:23 2021] POST /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 15:55:23.752610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:23.754205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:23.766919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:23.773588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.774659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.776919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:23.778655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:23.809962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:23.818127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:23.824472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dc190649-d17f-4c6c-bb60-00ec329408b1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.521193 Nov 10 15:55:23.825907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 43/97] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:24.110938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-02b43da0-4ba9-4acf-9e1b-c33ca2c94720 req-a4c48ded-22ec-4b65-bf44-5a66b20b2269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "name": "network-vif-plugged", "status": "completed", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:24.112768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:24.112768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:24.137064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-02b43da0-4ba9-4acf-9e1b-c33ca2c94720 req-a4c48ded-22ec-4b65-bf44-5a66b20b2269 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:24.152169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-02b43da0-4ba9-4acf-9e1b-c33ca2c94720 req-a4c48ded-22ec-4b65-bf44-5a66b20b2269 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:24.155930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:24.180025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-feda7b6f-c563-4af2-b0a0-4eb1be33fb7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.440549 Nov 10 15:55:24.190690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 55/98] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:23 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:24.199862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-02b43da0-4ba9-4acf-9e1b-c33ca2c94720 req-a4c48ded-22ec-4b65-bf44-5a66b20b2269 service nova] Creating event network-vif-plugged:d1fb9f0b-735b-4033-978f-e1637c0ce284 for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa on hv-cinder-81708 Nov 10 15:55:24.212515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-02b43da0-4ba9-4acf-9e1b-c33ca2c94720 req-a4c48ded-22ec-4b65-bf44-5a66b20b2269 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106223 Nov 10 15:55:24.216913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 44/99] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:55:24.848263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:24.849125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:24.856342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:24.857273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:24.858827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:24.859378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:25.052147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:25.062269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:25.064501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:25.066264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bc0494b1-d7fc-450a-856b-e32627346211 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.224447 Nov 10 15:55:25.067956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 56/100] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:55:25.203243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:25.204079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:25.211918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:25.212959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:25.214018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:25.214693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:25.442512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:25.453104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-da45589b-5ff0-4240-9fe4-5ad904ae97bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.255341 Nov 10 15:55:25.463696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 45/101] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:25 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:26.086025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:26.086807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:26.094181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:26.094657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:26.095696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:26.096382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:26.266313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:26.276420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:26.277931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:26.279347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-180d6c36-8780-4b4c-869d-d7b6897dd850 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1406 microversion: 2.20 time: 0.197426 Nov 10 15:55:26.280064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 57/102] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:55:26.471348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:26.472239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:26.479857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:26.480414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:26.481300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:26.481991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:26.656050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:26.684327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-135b6079-f90b-4d14-b891-3646580d5f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.216934 Nov 10 15:55:26.697398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 46/103] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:26 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:27.298383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:27.299202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:27.305673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.306248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:27.307389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.308055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:27.476319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:27.486913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:27.489037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:27.490749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aa419dc6-e8ee-4285-976c-3659738f0be1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1597 microversion: 2.20 time: 0.196219 Nov 10 15:55:27.491399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 58/104] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:55:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1597 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:55:27.511723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:27.512798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:27.521757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.522747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:27.525388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.526002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:27.630993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7681b327-9616-40f9-8252-2d4845de320f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123367 Nov 10 15:55:27.634578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 47/105] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Nov 10 15:55:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:55:27.702199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:27.702805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:27.717607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.719229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:27.720465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:27.722022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:28.200357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:28.211362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9209c591-b65b-431f-a75c-a53bcde0d826 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.512414 Nov 10 15:55:28.212210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 59/106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:27 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:29.231155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:29.231970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:29.243394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:29.243969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:29.251262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:29.253056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:29.500931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:29.513352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-67961b09-e75f-47b8-a2e7-91090a5cd551 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.286450 Nov 10 15:55:29.514331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 48/107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:29 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:30.108540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:30.109642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:30.112242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-b9de0fdf-4e43-45cb-b22e-6187f4ba6249 req-98142c36-7661-4413-8672-e97010ddf3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:30.114039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:30.114039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:30.122037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b9de0fdf-4e43-45cb-b22e-6187f4ba6249 req-98142c36-7661-4413-8672-e97010ddf3d7 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:30.130830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:30.130830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:30.130830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:30.130830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:30.136161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b9de0fdf-4e43-45cb-b22e-6187f4ba6249 req-98142c36-7661-4413-8672-e97010ddf3d7 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:30.163273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-b9de0fdf-4e43-45cb-b22e-6187f4ba6249 req-98142c36-7661-4413-8672-e97010ddf3d7 service nova] Creating event network-changed:d1fb9f0b-735b-4033-978f-e1637c0ce284 for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa on hv-cinder-81708 Nov 10 15:55:30.182934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-b9de0fdf-4e43-45cb-b22e-6187f4ba6249 req-98142c36-7661-4413-8672-e97010ddf3d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074394 Nov 10 15:55:30.183973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 49/108] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:55:30.334951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac10625d-01cf-49b5-948b-497cc6d80e1e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.230956 Nov 10 15:55:30.335912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 60/109] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:30 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:30.543060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:30.552463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:30.579755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:30.580741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:30.590305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:30.591226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:30.944712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:30.957107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-daf716d1-4ec4-450c-ac8d-bdc78ab683ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.428225 Nov 10 15:55:30.957960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 50/110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:30 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:31.362567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:31.372059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:31.404562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:31.407454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:31.409611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:31.410431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:31.600136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5a0baebc-5487-41c2-a2a5-2661c4661f89 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.251887 Nov 10 15:55:31.607720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 61/111] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:31 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:31.973275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:31.973883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:31.981741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:31.982254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:31.988257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:31.989331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:32.208886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:32.225233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a2f41d13-43e2-44ad-9c91-1cb956128b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.255525 Nov 10 15:55:32.226030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 51/112] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:31 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:32.622429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:32.626209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:32.651750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:32.652195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:32.660663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:32.664147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:32.782909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:32.784394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:32.800979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:32.806725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:32.806725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:32.810642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dfc83bfb-e368-4d6b-9895-03f198d0e24c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.198455 Nov 10 15:55:32.810905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:32.811309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 62/113] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:32 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:32.857241 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 15:55:32.987079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-53968404-5531-4a31-b8e3-c1bff2bcb534 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 204 len: 0 microversion: 2.1 time: 0.231061 Nov 10 15:55:32.995002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 52/114] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 15:55:32 2021] DELETE /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:55:33.003759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:33.005552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:33.035713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.037019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.038718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.039839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.263845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:33.268568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:33.296260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.297066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.298514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.299277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.645969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:33.653712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c17426f7-228a-4c44-980a-dfaaecfb756a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.401664 Nov 10 15:55:33.659422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 53/115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:33 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:33.663108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:33.673098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8e551462-c24c-4d2e-be73-020b29e024bb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1553 microversion: 2.1 time: 0.678283 Nov 10 15:55:33.677360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 63/116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:32 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1553 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:33.823630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:33.824528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:33.831062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.831491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.832421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:33.832851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:33.949697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9d9eb52f-7dfe-4742-845a-79c52b5e85c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.116838 Nov 10 15:55:33.949697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 54/117] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:33 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:34.676413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:34.677169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:34.683718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.684264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.685131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.685721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.699459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:34.701085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:34.711670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.712543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.714995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.715926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.909218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:34.917893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-291b3eac-e828-4173-9ebe-a5b3f5753abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.245547 Nov 10 15:55:34.918868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 64/118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:34 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:34.962585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:34.963749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:34.970622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.971877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.972878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:34.973652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:34.977552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:35.009729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c2fea1e-a24c-4607-ad76-987747dcb233 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1553 microversion: 2.1 time: 0.315334 Nov 10 15:55:35.011393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 55/119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:34 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1553 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:35.083369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-05bb8b20-7096-464f-99d1-389d6fa16cc2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.138215 Nov 10 15:55:35.084086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 65/120] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:34 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:35.936097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:35.937128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:35.945500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:35.946341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:35.947900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:35.948679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.037061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:36.038428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:36.051862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:36.052312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.055102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:36.058556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.199022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:36.210828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:36.222969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a46d75a8-05be-4cfd-9338-1c4726a3c0e2 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1511 microversion: 2.1 time: 0.197465 Nov 10 15:55:36.223717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 66/121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:36 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:36.227633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a4e45d59-535f-425f-8042-884d0068a759 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.296164 Nov 10 15:55:36.231466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:36.235703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:36.238674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 56/122] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:35 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:36.255614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:36.256143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.256975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:36.258767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.269356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-0f76e2c5-6faf-4dc9-9c87-58ac257b5941 req-86d3197f-5250-48a8-8b1a-e6f1d6c01523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92cbc0f-22cf-403b-8756-c1a1e45cb7aa", "name": "network-vif-deleted", "tag": "1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:36.276973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:36.276973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:36.289860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-0f76e2c5-6faf-4dc9-9c87-58ac257b5941 req-86d3197f-5250-48a8-8b1a-e6f1d6c01523 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:36.290571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-0f76e2c5-6faf-4dc9-9c87-58ac257b5941 req-86d3197f-5250-48a8-8b1a-e6f1d6c01523 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:36.306105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-0f76e2c5-6faf-4dc9-9c87-58ac257b5941 req-86d3197f-5250-48a8-8b1a-e6f1d6c01523 service nova] Creating event network-vif-deleted:1b4c518f-1c9e-434c-b2b4-d2cc3be29a2f for instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa on hv-cinder-81708 Nov 10 15:55:36.318698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-0f76e2c5-6faf-4dc9-9c87-58ac257b5941 req-86d3197f-5250-48a8-8b1a-e6f1d6c01523 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062339 Nov 10 15:55:36.319441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 57/123] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:36.374456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-25e45b3a-c500-47b1-8ca2-345d22c4e641 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.149276 Nov 10 15:55:36.375298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 67/124] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:36 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:37.266711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:37.267339 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:37.267339 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:37.267822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:37.279640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.280500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.280848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.281898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.282709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.284336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.288462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.289162 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.337642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.338496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.338988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lazy-loading 'fault' on Instance uuid a92cbc0f-22cf-403b-8756-c1a1e45cb7aa {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:55:37.397525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '214880bcabcd45dd89753e769ca07220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957858dcc5384487a7ef337124998c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:37.408952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bcbb2f14-a542-49c0-9d55-441e67fc2b5b tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 200 len: 1351 microversion: 2.1 time: 0.170971 Nov 10 15:55:37.409547 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 58/125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:37 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:37.421411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:37.424748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:37.440135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.441783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.445022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:37.445706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:37.533130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-38ac04a4-be37-45e0-bd49-159b2270c40f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.119676 Nov 10 15:55:37.537521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 59/126] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:37 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:37.576716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:37.584647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df2eb13f-be74-4c4e-adcf-395396549a3c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.334214 Nov 10 15:55:37.585962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:37 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:38.428134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:38.428938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:38.441869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.443175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.444684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.445505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.473794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] HTTP exception thrown: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. Nov 10 15:55:38.474527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Returning 404 to user: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:55:38.475396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-628aecbe-ebb6-4b57-997f-0ba2e9b53391 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 404 len: 111 microversion: 2.1 time: 0.052376 Nov 10 15:55:38.479846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 60/128] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:38 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 10 15:55:38.546807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:38.548507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:38.556450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.557287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.558366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.559023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.601814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:38.602585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:38.610836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.611621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.612635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.613280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.645810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e70c9e22-879d-47a4-a59a-c989d3a0eb80 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.102555 Nov 10 15:55:38.647234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 69/129] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:38 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:38.792988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:38.804031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3f580b99-858a-4f88-ae4d-074cc5ea5cee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.205646 Nov 10 15:55:38.804872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 61/130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:38 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:38.814787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:38.816261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:38.825087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.825711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.826831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:38.827269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:38.848912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] HTTP exception thrown: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. Nov 10 15:55:38.852181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Returning 404 to user: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:55:38.852181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8eec5316-7184-4267-ba72-7f9bac9fb6eb tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040445 Nov 10 15:55:38.852181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 70/131] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:55:38 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:55:39.658419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:39.661297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:39.671613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:39.672777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:39.673887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:39.674530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:39.822807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:39.824306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:39.838517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:39.839403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:39.840363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:39.840944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:40.043166 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:40.058412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5f8be03d-aa96-422d-8033-2672202047bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.240049 Nov 10 15:55:40.059778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 71/132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:39 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:41.078007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:41.079032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:41.088082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:41.088823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:41.090186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:41.090913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:41.274597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:41.285118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ef32185f-5e39-44e2-9253-f1adf104450b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.211714 Nov 10 15:55:41.285751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 72/133] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:41 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:41.925674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1b4b7ecb-0c7f-4781-a785-5b3ff41de8b2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 2.271703 Nov 10 15:55:41.929733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 62/134] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:39 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:42.306717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:42.307583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:42.317956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:42.318463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:42.319271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:42.319706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:42.556390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:42.568327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbf6bf15-126c-4bf3-a716-32d046201681 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.266801 Nov 10 15:55:42.569324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 73/135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:42 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:42.940441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:42.942032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:42.952851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:42.953608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:42.954809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:42.955413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.053604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7205c951-4697-47cb-9b89-d5215b897c37 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 14 microversion: 2.20 time: 0.119442 Nov 10 15:55:43.054695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 63/136] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:42 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:43.467463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:43.468702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:43.480601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.481492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.483064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.483942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.502091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] HTTP exception thrown: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. Nov 10 15:55:43.503054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Returning 404 to user: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:55:43.503920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c11bd942-eff5-4ae1-9ee8-b7fca772e046 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 404 len: 111 microversion: 2.1 time: 0.044483 Nov 10 15:55:43.504504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 74/137] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 15:55:43 2021] DELETE /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:55:43.518430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:43.520025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] [instance: a92cbc0f-22cf-403b-8756-c1a1e45cb7aa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:43.533247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.534478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.536245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.536964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.562951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] HTTP exception thrown: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. Nov 10 15:55:43.564648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] Returning 404 to user: Instance a92cbc0f-22cf-403b-8756-c1a1e45cb7aa could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:55:43.566705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9efb74d-909b-451c-9cfb-750f6fba8bd6 tempest-DeleteServersTestJSON-304987159 tempest-DeleteServersTestJSON-304987159-project] 10.222.0.60 "GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa" status: 404 len: 111 microversion: 2.1 time: 0.053181 Nov 10 15:55:43.568170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 64/138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:43 2021] GET /compute/v2.1/servers/a92cbc0f-22cf-403b-8756-c1a1e45cb7aa => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:55:43.590281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:43.591515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:43.603831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.604696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.606700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:43.607824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:43.883682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:43.893593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4edd43ce-0f1a-4713-a51a-bf89a6a9a54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.309466 Nov 10 15:55:43.894974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 75/139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:43 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:44.066454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:44.068053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:44.076199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:44.077005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:44.078025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:44.078927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:44.915397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:44.917522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:44.927285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:44.932517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:44.933796 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:44.934517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:45.257760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:45.269588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b2c0ed45-f771-460f-8868-3760ffd92654 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.360810 Nov 10 15:55:45.280385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 76/140] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:44 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:46.291562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:46.296022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:46.304973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:46.306138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:46.307222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:46.311548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:46.499184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:46.532983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56389096-1a00-4cc1-a9d8-4b8fc0d8e3a4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 15025 microversion: 2.20 time: 2.471059 Nov 10 15:55:46.534045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 65/141] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:44 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 15025 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:55:46.539857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-18691655-d51d-4fe7-a765-e82440e37e9c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.254087 Nov 10 15:55:46.541024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 77/142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:46 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:47.548809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:47.550481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:47.580788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:47.580969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:47.581668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:47.583018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:47.583309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:47.583740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:47.609917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:47.613913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:47.618776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:47.623929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:47.777406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4cbd1f03-62e2-4525-a742-481fdca53c29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 18663 microversion: 2.20 time: 0.233438 Nov 10 15:55:47.779344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 66/143] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:47 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 18663 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:55:48.006652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:48.018118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-936342555", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "dcfba35b-5a66-47f5-96dc-9f6b79831f53"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:48.024659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2b50774-da9a-4ee3-8254-e301a8ab5d6b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.450593 Nov 10 15:55:48.027683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 78/144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:47 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:48.199454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] validate_networks() for [('dcfba35b-5a66-47f5-96dc-9f6b79831f53', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:55:48.799784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:48.801809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:48.808965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:48.809672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:48.810999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:48.811592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:48.899061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ab159786-364e-461d-849d-ebcfa5180ea9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 20674 microversion: 2.20 time: 0.103456 Nov 10 15:55:48.899731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 79/145] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:48 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 20674 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:55:48.919332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:55:48.919909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:55:48.920665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:55:48.921071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:55:48.921475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:55:48.935088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:48.936334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:48.937934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:48.938404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:48.964711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:55:48.976689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for user d50d9103fa7d4f74bd77defac782f225 and project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:55:48.994070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:55:48.996986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:55:49.059375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:49.060747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:49.091283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-64c29f12-7248-4629-9765-d96c4a3094bb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304626 Nov 10 15:55:49.093307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 67/146] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:55:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:55:49.101960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:49.103659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:49.105115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:49.105804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:49.111578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2715c12e-6c6b-4e8f-bc03-e3b067d8a856 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:49.113004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2715c12e-6c6b-4e8f-bc03-e3b067d8a856 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:49.216497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2715c12e-6c6b-4e8f-bc03-e3b067d8a856 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:49.242883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2715c12e-6c6b-4e8f-bc03-e3b067d8a856 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1217 microversion: 2.1 time: 0.138848 Nov 10 15:55:49.251294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 68/147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:49 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:49.610393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:49.644267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3a1a50d4-f582-4614-b2be-5c46a7cdba3b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.593242 Nov 10 15:55:49.649322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 80/148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:49 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:49.916013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:49.917220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:49.940039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:49.940039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:49.941085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:49.944605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:50.082225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dcded7bd-2480-4efb-982d-7a5c26c586dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 22545 microversion: 2.20 time: 0.170988 Nov 10 15:55:50.082960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 69/149] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:49 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 22545 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:55:50.274646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:50.275853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:50.291042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:50.292709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:50.296637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:50.298299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:50.441571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:50.457546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-078a7501-5ab7-459d-83c5-4cc7d16c4176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1221 microversion: 2.1 time: 0.187713 Nov 10 15:55:50.459486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 81/150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:50 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:50.694358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:50.696848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:50.767449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:50.770012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:50.772491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:50.780408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:51.096070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:51.097214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:51.104989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:51.105463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:51.106314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:51.106824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:51.236608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b937542f-0fb4-4b09-bb90-ca632253db57 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 23656 microversion: 2.20 time: 0.145035 Nov 10 15:55:51.245368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 82/151] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:51 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 23656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:55:51.342118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:51.368390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2565b54b-174b-4583-b9c9-8acbf6264e23 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.693236 Nov 10 15:55:51.384059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 70/152] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:50 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:51.485115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:51.486475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:51.509717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:51.510390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:51.511552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:51.512239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:51.646465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:51.663374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fceed949-02fe-4f0a-8766-1baad44a9d1c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1277 microversion: 2.1 time: 0.182713 Nov 10 15:55:51.674200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 83/153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:51 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:52.256372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:52.261143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:52.292103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.294358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:52.296083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.296898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:52.397382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:52.398373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:52.411839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.417873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:52.421570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.422852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:52.671824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:52.682702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-602fa18f-c780-40c5-9345-13295f78be99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.289125 Nov 10 15:55:52.693137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 84/154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:52 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:52.698100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:52.698765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:52.706249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.706625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:52.707417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:52.707843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:53.107397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:53.121567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ed40c0ca-e1a4-41a9-9109-e3aebaeb75b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.426785 Nov 10 15:55:53.123177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 85/155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:52 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:53.702914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:53.703954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:53.715148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:53.717071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:53.718559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:53.720161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:54.006853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:54.024352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-39965e47-4ec4-4505-9984-145421a7e6aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.327524 Nov 10 15:55:54.026527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 86/156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:53 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:54.141503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:54.142470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:54.154422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:54.155179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:54.156360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:54.159202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:54.401874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:54.412183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b5830136-655c-4fbc-a605-d7154afe2395 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.275550 Nov 10 15:55:54.413093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 87/157] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:54 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:54.864007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f0af7efe-6d1f-4344-bad8-b68f5e0c484e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 26149 microversion: 2.20 time: 2.615796 Nov 10 15:55:54.870288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 71/158] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:52 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 26149 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:55:55.049801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:55.050996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:55.089663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.091085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:55.092851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.093910 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:55.459573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:55.470203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:55.493908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.494397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:55.495221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.495659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:55.500451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:55.531446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-36a66dba-8bdf-4973-ab2c-12cb663068e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.486901 Nov 10 15:55:55.532483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 88/159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:55 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:55.829354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:55.857069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1d9ab491-d233-4958-8e61-82c00008cd78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.419240 Nov 10 15:55:55.857926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 72/160] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:55 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:55.892788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:55.894970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:55.909065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.910430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:55.912286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:55.913398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:56.270973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-ab030af6-a2d4-4291-babc-221af50a92ab req-66830c09-3520-46e1-8c19-0f386d95b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f78d736-2ad3-4754-9535-b5b568684214", "tag": "7efb781b-3630-4096-879d-33f8232886c9"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:56.273860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:55:56.273860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:55:56.288291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-ab030af6-a2d4-4291-babc-221af50a92ab req-66830c09-3520-46e1-8c19-0f386d95b5ae service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:56.289509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-ab030af6-a2d4-4291-babc-221af50a92ab req-66830c09-3520-46e1-8c19-0f386d95b5ae service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:56.323723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-ab030af6-a2d4-4291-babc-221af50a92ab req-66830c09-3520-46e1-8c19-0f386d95b5ae service nova] Creating event network-changed:7efb781b-3630-4096-879d-33f8232886c9 for instance 1f78d736-2ad3-4754-9535-b5b568684214 on hv-cinder-81708 Nov 10 15:55:56.329321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-ab030af6-a2d4-4291-babc-221af50a92ab req-66830c09-3520-46e1-8c19-0f386d95b5ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061980 Nov 10 15:55:56.330076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 73/161] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:55:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:55:56.562680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:56.563815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:56.574089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:56.574860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:56.576249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:56.577013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:56.734916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:56.743243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b74ffbb7-1d08-4d0e-97cd-4a3e66375175 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.189156 Nov 10 15:55:56.743839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 74/162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:56 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:56.888186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:56.888798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:56.896207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:56.896654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:56.897452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:56.897882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:57.052804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:57.074285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87ae5484-fe74-4b60-8166-9a530f0e5fc3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.176857 Nov 10 15:55:57.074285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 75/163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:56 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:57.771047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:57.772357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:57.783856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:57.785499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:57.787690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:57.788486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:58.002349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:58.010829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dff5ff70-38d5-40ed-ae9d-26df21177b9a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.246146 Nov 10 15:55:58.011604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 76/164] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:57 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:55:58.080340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:58.081022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:58.088187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:58.088640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:58.089444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:58.089869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:58.103616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1a8cdae4-fc33-482f-b894-427620ba797f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 27490 microversion: 2.20 time: 2.219954 Nov 10 15:55:58.112306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 89/165] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:55 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 27490 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:55:58.299827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:58.314350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cb7fd27a-0d3a-4ab4-9802-7d9b1be86f95 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.237057 Nov 10 15:55:58.315457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 77/166] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:58 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:59.031854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:59.033665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:59.048050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.048506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.049582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.051705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.125716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:55:59.126992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:59.135807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.136254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.137050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.137469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.295229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:59.312670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a241d030-9c08-49ed-b209-0abb231ce010 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.286665 Nov 10 15:55:59.313751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 90/167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:59 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:55:59.339967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:55:59.342422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:55:59.352310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.353039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.354041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:55:59.354533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:55:59.528565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:55:59.539176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6e579fe6-5a66-4099-afa4-74670ecaae9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.206079 Nov 10 15:55:59.550388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 91/168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:55:59 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:00.335229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:00.335952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:00.342690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:00.343138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:00.343923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:00.344356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:00.496801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:00.505443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4f903f36-d485-4bdf-b87d-76a189d1e607 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.174345 Nov 10 15:56:00.506052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 92/169] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:00 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:00.561372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:00.562008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:00.569303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:00.569722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:00.570599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:00.571037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:00.746482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:00.758180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a137d6a9-870e-4368-a38c-a7a72e724c38 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.201026 Nov 10 15:56:00.759259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 93/170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:00 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:01.524535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:01.525211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:01.532452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:01.532900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:01.534014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:01.534481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:01.676620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:01.685655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-445b36e5-0e9d-47ab-8486-5c81b07c5ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.165035 Nov 10 15:56:01.686278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 94/171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:01 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:01.779879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:01.780700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:01.789513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:01.790148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:01.791112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:01.791669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:01.953591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:01.962513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac8c9811-f9b4-4dbe-9892-04edb13f0136 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.186865 Nov 10 15:56:01.963104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 95/172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:01 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:02.013635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1be1f785-57f7-4ffe-a021-41675d9a3a32 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28138 microversion: 2.20 time: 2.891938 Nov 10 15:56:02.015315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 78/173] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:55:59 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28138 bytes in 2896 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:02.704227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:02.704928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:02.712220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:02.712672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:02.713532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:02.713968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:02.897682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:02.910643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d11a788c-34ab-4717-9190-93a4ce040d24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.210713 Nov 10 15:56:02.911381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 96/174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:02 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:02.989053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:02.989831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:02.997616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:02.998054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:02.999332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:02.999810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:03.030829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:03.032437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:03.043769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:03.045791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:03.047817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:03.048585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:03.159821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ddf0669b-2c9e-45b0-8193-91dbc2cab68b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28138 microversion: 2.20 time: 0.135286 Nov 10 15:56:03.160705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 97/175] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:03 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28138 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:03.481168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:03.492964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2bd534a3-ad9a-4f44-94f3-1c05cc2dadad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.508252 Nov 10 15:56:03.493785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 79/176] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:02 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:03.940681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:03.941927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:03.955166 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:03.956212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:03.958077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:03.959860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:04.176961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:04.178579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:04.193735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:04.194509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:04.196323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:04.197317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:04.210536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:04.235364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f2ba8206-c4ed-462e-8758-b076b9d9afb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.302636 Nov 10 15:56:04.248864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 98/177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:03 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:04.351061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-364f265f-3792-421d-b47d-825388ae7674 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28138 microversion: 2.20 time: 0.180192 Nov 10 15:56:04.363842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 80/178] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:04 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28138 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:04.513361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:04.514526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:04.528845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:04.530656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:04.534741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:04.535759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:04.923688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:04.935568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c3860e18-6d22-4cb9-81da-11f35b6a6689 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.426484 Nov 10 15:56:04.944603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 99/179] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:04 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:05.283493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:05.284674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:05.294533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:05.294977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:05.295779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:05.296373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:05.370880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:05.373432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:05.389584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:05.390766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:05.392868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:05.393938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:05.515421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-47bd2c86-5dec-4172-866b-52094de8c21f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28429 microversion: 2.20 time: 0.151667 Nov 10 15:56:05.516077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 100/180] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:05 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28429 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:05.530391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:05.548498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-24d8a8e8-291e-4f14-99ba-e745b9593281 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1520 microversion: 2.1 time: 0.277163 Nov 10 15:56:05.549184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 81/181] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:05 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:05.968868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:05.973932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:06.021390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.023062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.024887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.025729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.481677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:06.491241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d17ec20f-e94b-4482-8f16-d37fa303c088 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.540286 Nov 10 15:56:06.503071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 101/182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:05 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:06.536463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:06.540352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:06.578707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.579787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:06.580813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.582723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.584091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.587488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:06.622188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.623870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.625117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.625801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.674709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9239c125-b3cb-4f26-9d54-60ec52219e84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28594 microversion: 2.20 time: 0.147647 Nov 10 15:56:06.675367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 82/183] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:06 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28594 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:06.846247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:06.863711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ef628ba7-ad1f-41aa-86de-bcaddb1d65b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1500 microversion: 2.1 time: 0.300807 Nov 10 15:56:06.875062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 102/184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:06 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:06.886717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:06.889049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:06.905165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.906317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:06.908367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:06.909383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:07.377319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:07.411107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-11d3c6fd-c1e2-4721-b7f7-b547e93f230b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1514 microversion: 2.1 time: 0.529147 Nov 10 15:56:07.412887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 83/185] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1514 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:07.509333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:07.509959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:07.520597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:07.526781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:07.529636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:07.531014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:07.689321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:07.690284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:07.703467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:07.703930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:07.713633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:07.714121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:07.852487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-acea326f-4ef1-44dd-b745-aa505931fafe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28594 microversion: 2.20 time: 0.166454 Nov 10 15:56:07.854390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 84/186] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:07 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28594 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:07.865575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:07.888062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f3ac0d54-1d6f-4f4b-939c-367b1379131c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.382056 Nov 10 15:56:07.888823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 103/187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:07 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:08.619266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-8a41279d-fb58-494b-8396-53e0fa93538b req-3f009025-9b93-4e87-9e89-b35761d8d30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f78d736-2ad3-4754-9535-b5b568684214", "name": "network-vif-plugged", "status": "completed", "tag": "7efb781b-3630-4096-879d-33f8232886c9"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:08.622006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:08.622006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:08.633595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-8a41279d-fb58-494b-8396-53e0fa93538b req-3f009025-9b93-4e87-9e89-b35761d8d30a service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:08.634750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-8a41279d-fb58-494b-8396-53e0fa93538b req-3f009025-9b93-4e87-9e89-b35761d8d30a service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:08.651299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-8a41279d-fb58-494b-8396-53e0fa93538b req-3f009025-9b93-4e87-9e89-b35761d8d30a service nova] Creating event network-vif-plugged:7efb781b-3630-4096-879d-33f8232886c9 for instance 1f78d736-2ad3-4754-9535-b5b568684214 on hv-cinder-81708 Nov 10 15:56:08.657346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-8a41279d-fb58-494b-8396-53e0fa93538b req-3f009025-9b93-4e87-9e89-b35761d8d30a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045978 Nov 10 15:56:08.659089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 85/188] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:08.869334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:08.873485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:08.885654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:08.886600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:08.887648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:08.888224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:08.914748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:08.921704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:08.933712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:08.934826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:08.936097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:08.936768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:09.203111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:09.215480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-14d53dc2-f7e1-4752-b325-aca941a953d2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.310277 Nov 10 15:56:09.216915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 86/189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:08 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:10.254619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:10.256643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:10.267136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:10.267654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:10.268612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:10.269229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:10.475226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:10.483980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-19de2f6e-7f4d-460a-8b8b-24a20b46761b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.246602 Nov 10 15:56:10.484561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 87/190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:10 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:11.127681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f3067b73-b83c-4994-99d9-3831f0331ede tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28594 microversion: 2.20 time: 2.265304 Nov 10 15:56:11.132555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 104/191] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:08 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28594 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:11.513076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:11.513733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:11.520696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.521145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.521932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.522407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.569651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:11.570868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:11.581001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.581871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.583431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.583696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.620091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lazy-loading 'flavor' on Instance uuid f732db3a-a74d-4503-8538-9bcb4136479a {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:56:11.711566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df87a134-5c44-4f2e-bac6-fdfcb8ac377a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action" status: 200 len: 32 microversion: 2.1 time: 0.146068 Nov 10 15:56:11.712182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 105/192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 15:56:11 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 10 15:56:11.722067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:11.722827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:11.729815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.730320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.731184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:11.731987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:11.765208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:11.794068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0b6e8130-de9c-46d7-8b08-3f7eab8a0fa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.286334 Nov 10 15:56:11.794068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 88/193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:11 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:11.920449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:11.939761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dccbc408-b308-4816-83cc-df36e2694f43 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.221748 Nov 10 15:56:11.949706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 106/194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:12.141190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:12.142425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:12.151087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:12.152050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:12.152848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:12.153909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:12.236708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a9c86033-899d-4baf-89f9-1373c470e45a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28594 microversion: 2.20 time: 0.099244 Nov 10 15:56:12.246236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 89/195] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:12 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28594 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:12.815904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-617378381", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "e353ca86-44d3-43f8-b7a2-3bf8076aa375"}]}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:12.821218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:12.823388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:12.836801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:12.837744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:12.838784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:12.839412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:12.923893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] validate_networks() for [('e353ca86-44d3-43f8-b7a2-3bf8076aa375', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:56:13.171893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:13.201327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-762b306f-a55f-4f74-9cc2-ea047d65cf9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1317 microversion: 2.1 time: 0.375746 Nov 10 15:56:13.202269 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 90/196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:12 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:13.214964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:13.218610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:13.233759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.236606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.240296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.241964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.544132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:13.560986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:56:13.561507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:56:13.562068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:56:13.562577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:56:13.563051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:56:13.565587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e528e614-09e2-4d3e-8110-dbaa3963ef8f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.354377 Nov 10 15:56:13.575479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.575957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.576827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.577427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.580101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 91/197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:13.587982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:13.593544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:13.600461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.600987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.601857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:13.602519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:13.612508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Getting quotas for project 20ca518d4ee447b3b7ad79544ec13e0d. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:56:13.625154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Getting quotas for user d9cdb673ba1f417b8cc0734ad38ed57f and project 20ca518d4ee447b3b7ad79544ec13e0d. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:56:13.639379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:56:13.642588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:56:13.694897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-65532f4e-bc8f-4365-a027-c0cc385f1e06 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28594 microversion: 2.20 time: 0.112296 Nov 10 15:56:13.696411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 92/198] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:13 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28594 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:13.702954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a9bcb77b-83a2-47ba-b16b-7c34a64cf93c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890983 Nov 10 15:56:13.703765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 107/199] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:56:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:56:13.717194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5c8c64a9-be37-4173-a2fd-cfcf42ec87ad tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:13.717974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5c8c64a9-be37-4173-a2fd-cfcf42ec87ad tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:13.812209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5c8c64a9-be37-4173-a2fd-cfcf42ec87ad tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:13.822188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5c8c64a9-be37-4173-a2fd-cfcf42ec87ad tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1213 microversion: 2.1 time: 0.111205 Nov 10 15:56:13.834652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 93/200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:13 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:14.232816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:14.234748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:14.252277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.254127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.255506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.255965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.478441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:14.487619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-276fe15f-e2ca-4abc-ad77-fe034b1a38d0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1507 microversion: 2.1 time: 0.262078 Nov 10 15:56:14.488596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 108/201] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:14 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:14.587738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:14.588381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:14.596998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.598206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.599410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.600013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.708240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:14.709255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:14.717166 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.720704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.722940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.725342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.874260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:14.892346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ac3b22a2-891a-491d-8a55-e03d8cfc2b77 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.308054 Nov 10 15:56:14.895070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 94/202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:14.901730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d465f834-ec5b-4986-bdc7-923bc9473d3e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 28928 microversion: 2.20 time: 0.197057 Nov 10 15:56:14.909062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 109/203] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:14 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 28928 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:14.913589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:14.915184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:14.927975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.928414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:14.930039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:14.930865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:15.076105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:15.086915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3ade7049-f155-4b9a-bfa8-a1b755ee1eb1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1265 microversion: 2.1 time: 0.188196 Nov 10 15:56:15.100946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 95/204] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:14 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:15.914776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:15.916195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:15.921277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:15.923200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:15.924759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:15.925717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:15.926776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:15.927427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:15.940635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:15.941725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:15.942848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:15.943850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:16.072937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-babb132a-30d2-461a-8755-9f9f25d82fd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 30267 microversion: 2.20 time: 0.158274 Nov 10 15:56:16.074400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 96/205] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:15 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 30267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:56:16.107174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:16.108048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:16.120865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:16.121967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:16.123618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:16.124490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:16.146433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:16.155744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dad44630-3ab7-45a1-b7d6-5b54b4b6ec9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.246550 Nov 10 15:56:16.157144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 110/206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:16.222072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:16.228206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9258ac8-27ba-4287-bf34-6eb374f6802a"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:16.229483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:16.237412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:16.237665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c4bb950-80b7-4678-a65b-78305c9e7e5f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1271 microversion: 2.1 time: 0.135025 Nov 10 15:56:16.237862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:16.238712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:16.238874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 97/207] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:16 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:16.239555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:16.631110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1841106697", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "81585506-3d90-4ba8-9fb0-20442a59878e"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:16.639527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0ef0a961-9cd9-41af-9936-160b28bb6701 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414317 Nov 10 15:56:16.640688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 111/208] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:56:16 2021] POST /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:56:16.815916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] validate_networks() for [('81585506-3d90-4ba8-9fb0-20442a59878e', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:56:17.090896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:17.092728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:17.111798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.112579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.113965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.114997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.233515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-97680f0e-1e94-4846-9a16-a7aa83bd37f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 31729 microversion: 2.20 time: 0.148520 Nov 10 15:56:17.234701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 112/209] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:17 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 31729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:56:17.257119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:17.257959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:17.284471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.284471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.284471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.284471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.498917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:56:17.499460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:56:17.500012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:56:17.500803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:56:17.502717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:56:17.513455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.514116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.515065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.515589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.536728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Getting quotas for project dd267c8ea8e646dbbb902d8b5f8c31a0. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:56:17.544458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Getting quotas for user 2c17a5a54a8b40f9901f9b86b4353955 and project dd267c8ea8e646dbbb902d8b5f8c31a0. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:56:17.567335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:56:17.569468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:56:17.574926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:17.583854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fb393a5f-cc24-4ce8-9f8a-c5121aebe8bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.342303 Nov 10 15:56:17.598223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 113/210] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:17.598223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:17.598223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:17.610693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.611359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.612236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.612678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.661642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2bfc0854-60cf-4668-a0c1-1420b32ebd85 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040807 Nov 10 15:56:17.665902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 98/211] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:56:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 10 15:56:17.677456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-b415b2a1-2f48-4692-8aba-e43551465841 req-e78d88d6-1e72-4b88-82ca-1f1853c613b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adae5cd7-f890-4461-b12d-09152d4fb876", "tag": "6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:17.679277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:17.679277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:17.693825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b415b2a1-2f48-4692-8aba-e43551465841 req-e78d88d6-1e72-4b88-82ca-1f1853c613b8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:17.696640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b415b2a1-2f48-4692-8aba-e43551465841 req-e78d88d6-1e72-4b88-82ca-1f1853c613b8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:17.720423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-b415b2a1-2f48-4692-8aba-e43551465841 req-e78d88d6-1e72-4b88-82ca-1f1853c613b8 service nova] Creating event network-changed:6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb for instance adae5cd7-f890-4461-b12d-09152d4fb876 on hv-cinder-81708 Nov 10 15:56:17.731204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-b415b2a1-2f48-4692-8aba-e43551465841 req-e78d88d6-1e72-4b88-82ca-1f1853c613b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063263 Nov 10 15:56:17.731906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 99/212] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:17.748792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7f51df5d-7f5f-45c5-8182-2dda602c2345 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:17.749815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7f51df5d-7f5f-45c5-8182-2dda602c2345 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:17.831800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7f51df5d-7f5f-45c5-8182-2dda602c2345 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:17.839318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7f51df5d-7f5f-45c5-8182-2dda602c2345 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1219 microversion: 2.1 time: 0.104815 Nov 10 15:56:17.840616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 100/213] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:18.069177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:18.092812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-686d9673-4846-4e91-b4fd-ed806e6b38a1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.506932 Nov 10 15:56:18.093807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 114/214] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:17 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:18.251904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:18.261765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:18.270722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.271460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.272808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.273729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.391038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-efbbf45a-66b8-4728-aa80-ebcfbb6e5eb0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 32763 microversion: 2.20 time: 0.146993 Nov 10 15:56:18.391833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 101/215] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:18 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 32763 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:18.615006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:18.616667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:18.626933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.627665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.629016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.629691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.837678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:18.846054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ce4af7e1-40a3-4bdc-b846-0761c20ac54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.236823 Nov 10 15:56:18.847087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 115/216] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:18.866917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:18.867843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:18.878904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.879698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.881300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:18.881871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:18.978834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:18.989389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b7d5a812-3d4a-4b12-8f8c-843a8531d504 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1271 microversion: 2.1 time: 0.127379 Nov 10 15:56:18.990471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 102/217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:18 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:19.118268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:19.119455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:19.131017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.131902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:19.133425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.134386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:19.405717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:19.406913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:19.415132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.415679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:19.416563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.417081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:19.498430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:19.510691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8b133019-769c-4b43-81a8-b8c5fe55b413 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.398986 Nov 10 15:56:19.512332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-306718c5-2874-4c56-9524-056c46f72392 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 33126 microversion: 2.20 time: 0.110281 Nov 10 15:56:19.512564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 116/218] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:19 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:19.512989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 103/219] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:19 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 33126 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:56:19.876719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:19.878121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:19.897422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.898024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:19.899411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:19.900442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.021529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:20.025643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:20.043206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.044205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.045173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.045923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.162197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:20.169928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:20.176362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c131e11-c67f-4f48-bc01-3bce3f90ca51 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1277 microversion: 2.1 time: 0.162647 Nov 10 15:56:20.181661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-08aa5c36-2952-4167-a465-6859c346f7f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.313667 Nov 10 15:56:20.195721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 104/220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:20.195992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 117/221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:20.529409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:20.530014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:20.536617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:20.538077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:20.539146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.539647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.540596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.541191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.553083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.553829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.554964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:20.555870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:20.655215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0c5a01d0-1ee0-48dd-ad5a-7c81b1d14210 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 33575 microversion: 2.20 time: 0.125086 Nov 10 15:56:20.656271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 118/222] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:20 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 33575 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:20.856246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:20.867574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-16b73007-8785-4721-bf4f-4af838952b42 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.341677 Nov 10 15:56:20.868343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 105/223] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:20 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:21.205603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:21.207090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:21.209632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:21.210012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:21.220944 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.221374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.223352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.224130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.224809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.225259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.225777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.226885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.593973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:21.601078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:21.610153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b71b7c39-c877-49bf-9877-11eb36d93819 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.409012 Nov 10 15:56:21.610855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 106/224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:21.612308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ed7abb6f-4359-48b9-a479-50a27b5b8d81 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.417815 Nov 10 15:56:21.613759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 119/225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:21.617500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-ce9368e6-53f5-4b9f-a8b3-7b46a406fe14 req-c1ed957a-d970-4fbf-8607-c91ced0bd0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61231004-dfd0-4036-89ca-e554dfb3876c", "tag": "6d6ef20c-1c35-49f0-a66e-ac9018d2c5be"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:21.619321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:21.619321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:21.628450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-ce9368e6-53f5-4b9f-a8b3-7b46a406fe14 req-c1ed957a-d970-4fbf-8607-c91ced0bd0a4 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.628888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-ce9368e6-53f5-4b9f-a8b3-7b46a406fe14 req-c1ed957a-d970-4fbf-8607-c91ced0bd0a4 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.651808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-ce9368e6-53f5-4b9f-a8b3-7b46a406fe14 req-c1ed957a-d970-4fbf-8607-c91ced0bd0a4 service nova] Creating event network-changed:6d6ef20c-1c35-49f0-a66e-ac9018d2c5be for instance 61231004-dfd0-4036-89ca-e554dfb3876c on hv-cinder-81708 Nov 10 15:56:21.662690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-ce9368e6-53f5-4b9f-a8b3-7b46a406fe14 req-c1ed957a-d970-4fbf-8607-c91ced0bd0a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049737 Nov 10 15:56:21.664570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 107/226] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:21.673748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:21.675909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:21.698669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.699487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.700935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.701683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.828870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-82ccd43c-b689-45b2-9867-2dbdaab96219 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 34262 microversion: 2.20 time: 0.162530 Nov 10 15:56:21.829559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 120/227] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:21 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 34262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:21.897107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:21.897743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:21.905000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.905438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:21.906414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:21.906844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:22.147798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:22.156690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0bf45ee5-373e-41b3-b0d6-99e48e6bfa78 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.263896 Nov 10 15:56:22.157909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 108/228] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:21 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:22.633240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:22.634631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:22.645613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:22.646885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:22.647220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:22.648009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:22.649466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:22.650487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:22.659146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:22.660122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:22.661890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:22.662965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:23.170057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:23.170591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:23.180034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-db054553-6200-40b5-8693-86e14d9499c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.543803 Nov 10 15:56:23.180432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eab5a4d0-702e-429c-b26e-e28bcf68b8fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.555013 Nov 10 15:56:23.195795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 109/229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:23.196138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 121/230] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:23.196280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:23.196280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:23.196553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:23.196553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:23.196829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:23.196829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:23.196829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:23.197180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:23.204315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:23.205152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:23.206138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:23.206773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:23.305734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2ccbc39b-8ac2-44c7-96eb-682f134aae9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 35058 microversion: 2.20 time: 0.123251 Nov 10 15:56:23.307264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 110/231] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:23 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 35058 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:23.417308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:23.430723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d24b22dd-31a9-4f91-ac09-e772d573210d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.246985 Nov 10 15:56:23.431683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 122/232] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:23 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:24.214211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:24.214211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:24.215492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:24.215492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:24.228108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.228544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.228706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.229478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.229663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.230003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.231112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.231826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.565295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:24.579108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e85a2ab-7016-400f-9e61-dc7947c8fe60 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.374695 Nov 10 15:56:24.589069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:24.597725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 111/233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:24.600788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a3be0054-d25b-4ad9-a05c-43fd09ab31cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.393895 Nov 10 15:56:24.602181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 123/234] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:24.608400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:24.608737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:24.609681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:24.611045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:24.617363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.617822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.618914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.619363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.623267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.624354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.626060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.626852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.724474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ca08f466-c3b2-4090-9675-3103023792ce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 35982 microversion: 2.20 time: 0.124264 Nov 10 15:56:24.728451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 112/235] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:24 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 35982 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:24.730473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-b538f503-fcc6-4772-9ed6-08114df37914 req-daace134-897b-4513-8c56-24df15346632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adae5cd7-f890-4461-b12d-09152d4fb876", "name": "network-vif-plugged", "status": "completed", "tag": "6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:24.732217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:24.732217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:24.740723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b538f503-fcc6-4772-9ed6-08114df37914 req-daace134-897b-4513-8c56-24df15346632 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:24.741164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-b538f503-fcc6-4772-9ed6-08114df37914 req-daace134-897b-4513-8c56-24df15346632 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:24.757050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-b538f503-fcc6-4772-9ed6-08114df37914 req-daace134-897b-4513-8c56-24df15346632 service nova] Creating event network-vif-plugged:6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb for instance adae5cd7-f890-4461-b12d-09152d4fb876 on hv-cinder-81708 Nov 10 15:56:24.766404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-b538f503-fcc6-4772-9ed6-08114df37914 req-daace134-897b-4513-8c56-24df15346632 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 Nov 10 15:56:24.767252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 113/236] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:24.775190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1687438451", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "dcfba35b-5a66-47f5-96dc-9f6b79831f53"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:24.815538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:24.828186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-293c90df-da76-492e-8cc8-9ac0b447653b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.224186 Nov 10 15:56:24.830582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 124/237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:24 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:25.606332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:25.607025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:25.614152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:25.614663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:25.615477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:25.615998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:25.769461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:25.777556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-25fdfa75-9454-4c65-ac4a-8f7d4aa81e26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.175626 Nov 10 15:56:25.778992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 125/238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:25.784010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:25.785100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:25.795206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:25.795645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:25.796462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:25.796889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:25.992593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:26.002528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c100b3cc-dbb5-4fc5-85f1-e81bf3da7924 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.222670 Nov 10 15:56:26.003272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 126/239] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:26.009209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:26.010492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:26.017632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.018283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.019272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.019750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.124760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ff94e8ce-30ae-491f-9fd7-932e59774e9b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 36801 microversion: 2.20 time: 0.119944 Nov 10 15:56:26.125564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 127/240] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:26 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 36801 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:26.131384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:26.132080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:26.139974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.140417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.141221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.141997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.322309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:26.331714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-59974c55-9e78-4f70-802d-0d25baf827e1 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1313 microversion: 2.1 time: 0.204741 Nov 10 15:56:26.332338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 128/241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:26 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:26.796478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:26.797260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:26.804308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.804763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.805536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:26.805990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:26.974241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:26.981865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-608eb7c0-44da-4437-9624-7873d5c2e19c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.189481 Nov 10 15:56:26.982703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 129/242] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:26 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:27.024263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:27.025385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:27.033929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.034419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.035212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.035647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.183342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:27.192366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e3e2c310-9ba7-467c-8d9c-a7171f6245b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.174979 Nov 10 15:56:27.192954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 130/243] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:27.199834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:27.200818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:27.209903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.210472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.211279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.211705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.296075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-84a3e410-25ee-4833-b2b4-34b43c25aee1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 37644 microversion: 2.20 time: 0.101793 Nov 10 15:56:27.296807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 131/244] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:27 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 37644 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:27.354509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:27.355811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:27.366978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.367670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.368972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:27.369683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:27.545719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:27.554363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-62f091eb-3bdb-42bc-8469-7bc336fa876d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1497 microversion: 2.1 time: 0.206666 Nov 10 15:56:27.554959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 132/245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:27 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:28.000539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:28.001383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:28.008822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.009324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.010111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.010681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.202442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:28.216881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-23e43ca8-05e0-4f6b-91c8-09126147af92 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.218821 Nov 10 15:56:28.218480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 133/246] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:28.227305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:28.228148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:28.241206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.242759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.245526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.250208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.303808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 15:56:28.469091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-db41aae9-6552-42b9-b990-b04eb8d7ee1b tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "DELETE /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 204 len: 0 microversion: 2.1 time: 0.247863 Nov 10 15:56:28.470185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 134/247] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 15:56:28 2021] DELETE /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:56:28.479771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:28.481066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:28.487769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.488216 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.489030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.489468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.658135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:28.672525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f56d3e57-cef8-4457-a77d-47ac499929fe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.200106 Nov 10 15:56:28.673577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 135/248] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:28.681737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:28.683541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:28.694443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.695245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.696664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.697444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.794544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2155986-9347-4c5a-aa5c-62d761095670 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 38121 microversion: 2.20 time: 0.118886 Nov 10 15:56:28.795507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 136/249] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:28 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 38121 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:28.801081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:28.801812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:28.810078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.810562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.811359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:28.811784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:28.988697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:28.996861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee6a1e4a-3259-45ca-bdbd-6f65a3dbdabf tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1503 microversion: 2.1 time: 0.199964 Nov 10 15:56:28.997716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 137/250] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:28 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:29.247044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:29.248356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:29.260538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.261330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:29.262908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.263705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:29.447294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:29.455530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-191a6006-3968-4138-a62e-7169c721a7c3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.215333 Nov 10 15:56:29.456206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 138/251] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:29.691269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:29.692016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:29.699547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.699991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:29.700834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.701274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:29.864474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:29.875068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4e0825c1-2ac6-496a-92d0-2e7b868a3651 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.186907 Nov 10 15:56:29.893229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 139/252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:29.902404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:29.904440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:29.915725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.915961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] validate_networks() for [('dcfba35b-5a66-47f5-96dc-9f6b79831f53', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:56:29.916520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:29.917971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:29.918849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.044498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b120ffd2-8b13-4fc9-b22c-5a856d003cae tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 200 len: 38262 microversion: 2.20 time: 0.148181 Nov 10 15:56:30.046100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 140/253] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:29 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 38262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:30.056159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:30.057411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:30.068097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.068557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.069394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.069841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.315313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:30.329293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a42e4b02-6996-4c1e-ba53-a41111dae62d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1503 microversion: 2.1 time: 0.280649 Nov 10 15:56:30.342227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 141/254] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:30 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:30.342227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:30.342227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:30.350501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.351259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.352534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.353212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.386458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eab486c8-5243-4aca-9a9d-300f9296982c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/ips" status: 200 len: 151 microversion: 2.20 time: 0.054002 Nov 10 15:56:30.387158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 142/255] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Nov 10 15:56:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:56:30.441204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:56:30.441620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:56:30.442390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:56:30.442800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:56:30.443207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:56:30.454203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.454663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.455470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.456209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.480048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:56:30.485044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:30.485278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for user d50d9103fa7d4f74bd77defac782f225 and project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:56:30.486256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:30.505873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:56:30.508772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:56:30.513644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.514517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.515913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:30.516797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:30.602203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-edbfdb7d-35e4-4dcc-a061-f27138ee689e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.832970 Nov 10 15:56:30.610277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 114/256] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:56:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 5842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:56:30.620599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8712153f-0fa4-4a26-bb94-d287ba099f7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:30.621290 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8712153f-0fa4-4a26-bb94-d287ba099f7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:31.058451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8712153f-0fa4-4a26-bb94-d287ba099f7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:31.078921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8712153f-0fa4-4a26-bb94-d287ba099f7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1218 microversion: 2.1 time: 0.460911 Nov 10 15:56:31.080144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 115/257] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:30 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1218 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:31.090420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:31.093039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:31.106225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:31.108517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:31.109686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:31.110220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:31.277427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:31.314416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-25c00071-2eff-4915-bfbe-fa5808ac385e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.843577 Nov 10 15:56:31.318861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 143/258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:31.351680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:31.352449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:31.359449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:31.360068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:31.361018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:31.361525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:31.493546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:31.501844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-932c6140-6930-4a6c-93ac-4c7cfa48c332 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.419599 Nov 10 15:56:31.511749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 116/259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:31.686336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:31.695903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-24f12f47-765b-4e16-af08-8166fde1b7fb tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1503 microversion: 2.1 time: 0.348032 Nov 10 15:56:31.696491 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 144/260] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:31 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:31.916509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-01db48fa-121b-496f-87ad-51d45aa1559f req-49418d20-295a-42a3-aa30-6fc48f4b2562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adae5cd7-f890-4461-b12d-09152d4fb876", "name": "network-vif-deleted", "tag": "6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:31.919763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:31.919763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:31.935490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-01db48fa-121b-496f-87ad-51d45aa1559f req-49418d20-295a-42a3-aa30-6fc48f4b2562 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:31.936238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-01db48fa-121b-496f-87ad-51d45aa1559f req-49418d20-295a-42a3-aa30-6fc48f4b2562 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:31.961486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-01db48fa-121b-496f-87ad-51d45aa1559f req-49418d20-295a-42a3-aa30-6fc48f4b2562 service nova] Creating event network-vif-deleted:6d14e1a5-ba3b-47eb-92e1-fedbbe951cdb for instance adae5cd7-f890-4461-b12d-09152d4fb876 on hv-cinder-81708 Nov 10 15:56:31.969845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-01db48fa-121b-496f-87ad-51d45aa1559f req-49418d20-295a-42a3-aa30-6fc48f4b2562 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062794 Nov 10 15:56:31.971056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 117/261] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:32.097744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:32.098382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:32.105435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.106362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.107014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.107457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.214047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:32.229867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9b6a6aee-31d7-4c63-a624-1fd9b3ed3121 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1270 microversion: 2.1 time: 0.136129 Nov 10 15:56:32.248748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 145/262] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:32 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:32.352836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:32.356180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:32.374285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.376004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.377617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.378511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.519311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:32.520462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:32.527369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.528088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.528889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.529326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.804625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:32.831749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9261120d-c5af-4c6e-9d89-713159a0a1a0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.488111 Nov 10 15:56:32.839629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 118/263] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:32.848279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:32.849622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:32.859459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.860220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.861748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.862616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.906667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:32.908208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:32.909051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lazy-loading 'fault' on Instance uuid adae5cd7-f890-4461-b12d-09152d4fb876 {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:56:32.992969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:33.003589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-28de4afa-9110-4dfd-80d3-85105296493d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 200 len: 1303 microversion: 2.1 time: 0.161606 Nov 10 15:56:33.015523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 119/264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:32 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:33.023648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:33.048131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c8c485ff-74fd-49a8-9bb1-c3d186fe49d3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1520 microversion: 2.1 time: 0.531922 Nov 10 15:56:33.051287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 146/265] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1520 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:33.257667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:33.259546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:33.271214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.271911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.272902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.273432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.343727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:33.344669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:33.356318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.357086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.358569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.359352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.371498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:33.387691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dfae3de7-15cc-46c9-bac0-1274874b82fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1276 microversion: 2.1 time: 0.133789 Nov 10 15:56:33.396094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lazy-loading 'flavor' on Instance uuid 30898884-8dbc-4a4a-a1ac-e586e9254eaa {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:56:33.396441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 120/266] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:33 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:33.834020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-33dfc6f7-4964-4d87-bae9-652492749fd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 202 len: 0 microversion: 2.20 time: 0.497072 Nov 10 15:56:33.836701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 147/267] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:56:33 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:56:33.851675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:33.853243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:33.871349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:33.878054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:33.879921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.880706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.882115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.882920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.895567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.897816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:33.899732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:33.901880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.245168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.257645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.261740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.266241 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.270986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8b000627-1292-47c2-8475-4de9b56a5ecb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.428299 Nov 10 15:56:34.273649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b431eb9a-73a4-4e29-ba47-cb2f235527fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.415979 Nov 10 15:56:34.287231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 121/268] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:33 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:34.293308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 148/269] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:33 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:34.305950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:34.308388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:34.320759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:34.322373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: adae5cd7-f890-4461-b12d-09152d4fb876] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:34.323296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.324398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.325978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.326893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.340628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.341794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.343401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.344341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.373537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] HTTP exception thrown: Instance adae5cd7-f890-4461-b12d-09152d4fb876 could not be found. Nov 10 15:56:34.375361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Returning 404 to user: Instance adae5cd7-f890-4461-b12d-09152d4fb876 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:56:34.376580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-90c486fd-8221-4147-9188-001b264b4700 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876" status: 404 len: 111 microversion: 2.1 time: 0.077924 Nov 10 15:56:34.377785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 122/270] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:34 2021] GET /compute/v2.1/servers/adae5cd7-f890-4461-b12d-09152d4fb876 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:56:34.416958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:34.418254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:34.432166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.432993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.436756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.437912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.819696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.828408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f86f1d4b-dd27-424f-b43c-e08d1aaa1dfa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.426437 Nov 10 15:56:34.829091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 123/271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:34 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:34.832616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:34.840422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-676221941", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "e353ca86-44d3-43f8-b7a2-3bf8076aa375"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:34.849310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7d53642a-3e7e-4102-b3ea-e8bc025c308a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1500 microversion: 2.1 time: 0.553053 Nov 10 15:56:34.850797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 149/272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1500 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:34.934229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] validate_networks() for [('e353ca86-44d3-43f8-b7a2-3bf8076aa375', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:56:34.955462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7db8c058-959c-40bd-b363-98f85cd4e021"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:34.957531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:34.968158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.970337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:34.971764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:34.972574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.005446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] HTTP exception thrown: Cannot 'attach_volume' instance f732db3a-a74d-4503-8538-9bcb4136479a while it is in vm_state rescued Nov 10 15:56:35.006498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Returning 409 to user: Cannot 'attach_volume' instance f732db3a-a74d-4503-8538-9bcb4136479a while it is in vm_state rescued {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:56:35.007675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-14cec693-0a5a-44f4-b309-fd54953168af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062062 Nov 10 15:56:35.008529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 150/273] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:56:34 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 10 15:56:35.015348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-fa030634-b0e3-48c7-a800-45dc58289184 req-b9c9ee39-6009-4053-91e7-f0f3b974d090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309121c6-e652-4f46-abe4-3db6f43261c8", "tag": "e3fd1062-bc94-48e4-9295-a035dcf9fb65"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:35.018945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:35.018945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:35.027686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-fa030634-b0e3-48c7-a800-45dc58289184 req-b9c9ee39-6009-4053-91e7-f0f3b974d090 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.028267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-fa030634-b0e3-48c7-a800-45dc58289184 req-b9c9ee39-6009-4053-91e7-f0f3b974d090 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.047328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-fa030634-b0e3-48c7-a800-45dc58289184 req-b9c9ee39-6009-4053-91e7-f0f3b974d090 service nova] Creating event network-changed:e3fd1062-bc94-48e4-9295-a035dcf9fb65 for instance 309121c6-e652-4f46-abe4-3db6f43261c8 on hv-cinder-81708 Nov 10 15:56:35.056814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-fa030634-b0e3-48c7-a800-45dc58289184 req-b9c9ee39-6009-4053-91e7-f0f3b974d090 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045990 Nov 10 15:56:35.058297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 151/274] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:35.070405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:35.071618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:35.083895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.085091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.086805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.087691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.215675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e07b1dce-f23f-439a-8abe-46aab6a671ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action" status: 202 len: 0 microversion: 2.1 time: 0.154031 Nov 10 15:56:35.217619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 152/275] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 15:56:35 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:35.231010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:35.233137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:35.245975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.246855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.248293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.248933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.927257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:35.941272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-02415ebe-1662-486e-a4df-7de2e8af4e3d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1508 microversion: 2.1 time: 0.717863 Nov 10 15:56:35.942943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 153/276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1508 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:35.948720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:35.950870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:35.959259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.960375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:35.961684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:35.962247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.216109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:56:36.217731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:56:36.219740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:56:36.221781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:56:36.222527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:56:36.263866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.264523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.266129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.267190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.324873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Getting quotas for project 20ca518d4ee447b3b7ad79544ec13e0d. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:56:36.334546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Getting quotas for user d9cdb673ba1f417b8cc0734ad38ed57f and project 20ca518d4ee447b3b7ad79544ec13e0d. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:56:36.380239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:56:36.386202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:56:36.432857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:36.462212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f159a341-25b3-4b4b-965f-3a24187ef9b4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.513043 Nov 10 15:56:36.463899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 154/277] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:35 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:36.474934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:36.477949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:36.493160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.493958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.495075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.495683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.541006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56f0601c-5e83-4c4b-bf25-710e4f658860 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705109 Nov 10 15:56:36.542452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 124/278] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:56:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:56:36.560828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:36.562514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:36.579631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.580552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:36.581717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:36.582396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.060344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.069454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.087062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-49af2bd4-5ffc-438d-86e8-18970e28178e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.541469 Nov 10 15:56:37.088018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 125/279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:36 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:37.100142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.103737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.107434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d6fd0108-d50c-4831-b6ae-7b97b50e277c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.641469 Nov 10 15:56:37.109344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 155/280] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:37.114950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-28f07860-ee97-4617-b8f1-50138dab7196 req-d0f65e62-a175-4ccb-9a8f-3711c5d35fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61231004-dfd0-4036-89ca-e554dfb3876c", "name": "network-vif-plugged", "status": "completed", "tag": "6d6ef20c-1c35-49f0-a66e-ac9018d2c5be"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:37.116926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:37.116926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:37.126105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c74dbf60-f67b-4cdd-bd4f-92dd10e0a538 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:37.126667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-28f07860-ee97-4617-b8f1-50138dab7196 req-d0f65e62-a175-4ccb-9a8f-3711c5d35fd2 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:37.127288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-28f07860-ee97-4617-b8f1-50138dab7196 req-d0f65e62-a175-4ccb-9a8f-3711c5d35fd2 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.143616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c74dbf60-f67b-4cdd-bd4f-92dd10e0a538 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:37.146097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-28f07860-ee97-4617-b8f1-50138dab7196 req-d0f65e62-a175-4ccb-9a8f-3711c5d35fd2 service nova] Creating event network-vif-plugged:6d6ef20c-1c35-49f0-a66e-ac9018d2c5be for instance 61231004-dfd0-4036-89ca-e554dfb3876c on hv-cinder-81708 Nov 10 15:56:37.153220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-28f07860-ee97-4617-b8f1-50138dab7196 req-d0f65e62-a175-4ccb-9a8f-3711c5d35fd2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041448 Nov 10 15:56:37.154128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 156/281] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:37.161110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:37.162210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:37.170585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:37.171363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.172550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:37.173154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.295886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c74dbf60-f67b-4cdd-bd4f-92dd10e0a538 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.303699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c74dbf60-f67b-4cdd-bd4f-92dd10e0a538 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1213 microversion: 2.1 time: 0.214115 Nov 10 15:56:37.304601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 126/282] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:37 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:37.407956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.416300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0a376b30-f3f8-40ce-a8bb-544c3f3e07cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1508 microversion: 2.1 time: 0.260539 Nov 10 15:56:37.416901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 157/283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:37.482554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:37.483216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:37.490650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:37.491228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.492060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:37.492488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:37.642585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:37.651375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1ce88d74-088b-4845-8db2-e86cb47b2eac tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.173224 Nov 10 15:56:37.652077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 127/284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:38.105554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:38.106456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:38.113460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.113913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.114772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.115209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.142711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:38.143478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:38.152963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.153638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.155362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.156133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.453164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.461486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-39a1724d-f079-45f3-983e-3d347ace18c6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.359822 Nov 10 15:56:38.462081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 158/285] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:38 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:38.467572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.471821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:38.472952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:38.477489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.479248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.480624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb89e6cd-4914-4fa0-bc83-6b0bf4a567c0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.342423 Nov 10 15:56:38.481748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 128/286] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:56:38.484722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.485662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.486765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:38.487186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.487356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:38.487969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.493655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.494079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.496448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.496448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.592949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.602439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ee21042-994e-4ed1-afe7-50e23c4a653e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1217 microversion: 2.1 time: 0.139065 Nov 10 15:56:38.603032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 159/287] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:38 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:38.673049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:38.674459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:38.677468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.683792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.684517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.685841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:38.686581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:38.690699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c22f8ca4-af03-4478-9b15-73bb1b6cd42b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1508 microversion: 2.1 time: 0.207440 Nov 10 15:56:38.691642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 129/288] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:38.863211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:38.871170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ea6d591-1873-4d1e-ba3f-f96b600f4bc9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.204918 Nov 10 15:56:38.872289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 160/289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:39.482827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:39.483521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:39.490654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.491098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.491897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.492324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.511536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:39.512462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:39.521273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.522044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.523462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.524250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.680435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.688894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2a14d1d0-b79f-4228-92fd-5e55005a3377 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.210317 Nov 10 15:56:39.689515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 130/290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:39 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:39.701025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:39.701635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:39.708279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.708722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.709544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.709966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.739054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.751278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.752782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.753967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-69a13a3e-1178-456b-898c-c486d5c47414 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.247007 Nov 10 15:56:39.754555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 161/291] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:39 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:56:39.759068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:39.759794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:39.769317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.769802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.770628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.771057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.796742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.806828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8297b7a1-8931-49f3-9a31-1320a5822cce tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1217 microversion: 2.1 time: 0.109487 Nov 10 15:56:39.807641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 131/292] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:39 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:39.894928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:39.895614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:39.902539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.904924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.905743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:39.906745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:39.948673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:39.960577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-041a11e5-92e3-44e5-9b0a-a20359b13890 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1508 microversion: 2.1 time: 0.204300 Nov 10 15:56:39.961684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 162/293] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:40.062931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:40.071210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-31da1cdc-d261-462a-b9db-6c81a0bce42a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.184624 Nov 10 15:56:40.071827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 132/294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:40.706066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:40.707114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:40.714301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.714762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.715702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.716336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.773092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:40.773717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:40.780620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.781068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.781894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.782693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.896611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:40.912279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3c3fa007-5f1f-4a60-8adf-b9a42bf04a8e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.210296 Nov 10 15:56:40.913091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 163/295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:40 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:40.919400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:40.920890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:40.931560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.932340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.933866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:40.936360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:40.978084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:40.988271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:40.989892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:40.991589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-73fa5b05-319c-47fa-ad67-c90b4a8e5dbd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.222773 Nov 10 15:56:41.006198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 133/296] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:40 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:41.006198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:41.006198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:41.006198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.007143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:41.007143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.007143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:41.008008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:41.018592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c4c69405-156c-4f4b-8c6a-29e29064f38c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1265 microversion: 2.1 time: 0.103889 Nov 10 15:56:41.027106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 164/297] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:40 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:41.088561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:41.089224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:41.096319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.096319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:41.097440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.098036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:41.204461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:41.221040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0fe585a4-fb29-4f90-a04f-4263ff9f9375 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1508 microversion: 2.1 time: 0.226856 Nov 10 15:56:41.222128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 134/298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:41.287053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:41.295623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6170bff5-6fd2-498b-8848-b11f98d41f95 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1319 microversion: 2.1 time: 0.210818 Nov 10 15:56:41.296230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 165/299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:41 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:41.931645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:41.932253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:41.943907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.944793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:41.945850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:41.946362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.024460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:42.027994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:42.040548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.041399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.042417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.043716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.198253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.210335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d2eff081-e0dd-4e98-ad1b-ab6afbffbf41 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.282501 Nov 10 15:56:42.211172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 135/300] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:41 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:42.217176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:42.218227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:42.225213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.225739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.227428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.227947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.368153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.390561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.393230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.394993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c78408ac-eca5-4366-a4dd-3efcdb38ba1c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.377902 Nov 10 15:56:42.396885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 166/301] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:42.412108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:42.412979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:42.419851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.420590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.421567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.422187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.483823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.493423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ee8f36a7-7a73-4c32-9e4d-4038a1d1b5d5 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.280922 Nov 10 15:56:42.494798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 136/302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:42 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:42.504042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:42.504979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:42.521560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.522840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.524599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.525595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.771507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.779623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e0c0026f-d8ca-49d1-9d13-b8b7877e5af9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1514 microversion: 2.1 time: 0.380774 Nov 10 15:56:42.780218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 167/303] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1514 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:42.785662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-07a8bf71-2284-4588-8891-d25b56f5265a req-2c96d2e1-62af-47d8-82bc-2160d828664b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309121c6-e652-4f46-abe4-3db6f43261c8", "name": "network-vif-plugged", "status": "completed", "tag": "e3fd1062-bc94-48e4-9295-a035dcf9fb65"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:42.787576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:42.787576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:42.795536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-07a8bf71-2284-4588-8891-d25b56f5265a req-2c96d2e1-62af-47d8-82bc-2160d828664b service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.796387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-07a8bf71-2284-4588-8891-d25b56f5265a req-2c96d2e1-62af-47d8-82bc-2160d828664b service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:42.811094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-07a8bf71-2284-4588-8891-d25b56f5265a req-2c96d2e1-62af-47d8-82bc-2160d828664b service nova] Creating event network-vif-plugged:e3fd1062-bc94-48e4-9295-a035dcf9fb65 for instance 309121c6-e652-4f46-abe4-3db6f43261c8 on hv-cinder-81708 Nov 10 15:56:42.818558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-07a8bf71-2284-4588-8891-d25b56f5265a req-2c96d2e1-62af-47d8-82bc-2160d828664b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036616 Nov 10 15:56:42.819797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 168/304] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:42.869942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:42.880729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8f20b594-9ab8-48ca-948b-f6f52cf287d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1508 microversion: 2.1 time: 0.384378 Nov 10 15:56:42.881322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 137/305] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:42.968150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-ba41b92b-1bfb-4a68-b572-60cc0888522d req-a045a809-8bc8-46bc-b500-683062fe8159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24fbe7e-4415-408a-b418-059d3d639472", "tag": "d4c6bf00-4827-4fff-85a1-3a94863e38e0"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:42.981319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:42.981319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:42.998560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-ba41b92b-1bfb-4a68-b572-60cc0888522d req-a045a809-8bc8-46bc-b500-683062fe8159 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:42.999567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-ba41b92b-1bfb-4a68-b572-60cc0888522d req-a045a809-8bc8-46bc-b500-683062fe8159 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.027825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-ba41b92b-1bfb-4a68-b572-60cc0888522d req-a045a809-8bc8-46bc-b500-683062fe8159 service nova] Creating event network-changed:d4c6bf00-4827-4fff-85a1-3a94863e38e0 for instance a24fbe7e-4415-408a-b418-059d3d639472 on hv-cinder-81708 Nov 10 15:56:43.033349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-ba41b92b-1bfb-4a68-b572-60cc0888522d req-a045a809-8bc8-46bc-b500-683062fe8159 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074722 Nov 10 15:56:43.034679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 169/306] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:43.232306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:43.233775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:43.242846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.243817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.244913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.245404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.405588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:43.416757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4bcfb72f-f4f8-46ff-9e6d-e97a4ea1afdd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.190809 Nov 10 15:56:43.420051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:43.421611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:43.426776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 138/307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:43 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:43.428823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.429449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.430624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.431383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.513200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:43.513919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:43.523994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.524432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.525218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:43.525633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:43.638579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:43.647605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:43.649137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:43.650719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a35df782-16bf-4349-a770-0f943b2b2a7d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.238082 Nov 10 15:56:43.651640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 170/308] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:44.066405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:44.075527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ed507c0a-843b-41c4-8fcc-04f6565e56d4 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.566078 Nov 10 15:56:44.076334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 139/309] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:43 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:44.411721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:44.412332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:44.420663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.421033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.421832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.422331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.433964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:44.435166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:44.443077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.443896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.445263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.445899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.734608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:44.743473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1301ab24-c389-4aea-8a61-0d4c2f59b7ee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1514 microversion: 2.1 time: 0.335394 Nov 10 15:56:44.744083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 171/310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1514 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:56:44.754366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:44.754366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:44.757313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.757803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.758662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.759090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.791469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:44.799584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c7fdea6d-f8d1-47ce-a8b8-beef3736a1f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1318 microversion: 2.1 time: 0.369361 Nov 10 15:56:44.800155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 140/311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:44 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:44.804974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7bdfbe6-efb7-4bf3-965b-0044f8279be8"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:44.806325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:44.812658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.813025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:44.813807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:44.814342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:45.073748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:45.083115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:45.086725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:45.088034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-616eb3ce-7f3b-44b9-acb9-aea2c4ff5070 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.342410 Nov 10 15:56:45.088610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 172/312] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:45.094107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:45.094672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:45.100671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:45.101122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:45.101930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:45.102366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:45.159216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0910be2e-14c1-46df-8217-225a71b3d3e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357718 Nov 10 15:56:45.160534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 141/313] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:56:44 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:45.462695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:45.471323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-656088ec-cfa6-407a-ab6f-1ff83f0137ab tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.381479 Nov 10 15:56:45.471907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 173/314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:45 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:45.817786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:45.818611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:45.832008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:45.832475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:45.833273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:45.833691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:45.981964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:45.992372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a4e7dba3-2cbe-405f-9fef-3dc0d186bd6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1509 microversion: 2.1 time: 0.179023 Nov 10 15:56:45.993024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 142/315] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:45 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:46.009919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9258ac8-27ba-4287-bf34-6eb374f6802a"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:46.011099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:46.018415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.019129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.019954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.020388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.108395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:46.109011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:46.116243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.116682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.117479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.118017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Invalid volume: volume c9258ac8-27ba-4287-bf34-6eb374f6802a is already attached to instances: 1f78d736-2ad3-4754-9535-b5b568684214 Nov 10 15:56:46.118232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.118681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 400 to user: Invalid volume: volume c9258ac8-27ba-4287-bf34-6eb374f6802a is already attached to instances: 1f78d736-2ad3-4754-9535-b5b568684214 {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:56:46.119526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-addf20cc-3d5e-4862-acd7-636be3f6321d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113786 Nov 10 15:56:46.120232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 174/316] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:56:46 2021] POST /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 10 15:56:46.199425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:46.199832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:46.207351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.207825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.208639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.209103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.289654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:46.299179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:46.300795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:46.302634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2a6a929b-1b1d-42c4-b940-19df57c5597a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.199352 Nov 10 15:56:46.314737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 143/317] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:46 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:46.384470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lazy-loading 'services' on Instance uuid 1f78d736-2ad3-4754-9535-b5b568684214 {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:56:46.488648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:46.489352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:46.495835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.496457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.497340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.497947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.531795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fd68e5d7-4a44-46ee-95f1-dc638f54ae94 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments/c9258ac8-27ba-4287-bf34-6eb374f6802a" status: 202 len: 0 microversion: 2.1 time: 0.336148 Nov 10 15:56:46.533232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 175/318] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 15:56:46 2021] DELETE /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments/c9258ac8-27ba-4287-bf34-6eb374f6802a => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:56:46.549716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:46.551023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:46.559736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.560395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.561447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:46.562106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:46.601767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2815d6dd-fbe0-4632-add2-147ad8b26a1e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059152 Nov 10 15:56:46.602391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 176/319] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:46 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:46.664436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:46.677429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d01ded70-51b0-4766-8ba4-b89715839aba tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.192066 Nov 10 15:56:46.678520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 144/320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:46 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:47.327473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:47.328622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:47.339142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.340046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.341675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.342510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.518528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:47.531605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:47.534141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:47.535520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-86b77f02-8ec3-4dad-9626-a9543c16e9ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.215597 Nov 10 15:56:47.536334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 177/321] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:47.616916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:47.619236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:47.626592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.627025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.628047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.628464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.664343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cd7f6ed9-2c28-48e2-a713-3ad5931424bd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053672 Nov 10 15:56:47.664918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 145/322] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:47 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:47.700855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:47.701495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:47.708683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.708998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.709887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:47.710358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:47.865152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:47.875066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa483ca6-e16b-47d2-93f9-519d8b1ff55e tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.177917 Nov 10 15:56:47.875708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 178/323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:47 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:48.557055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:48.557689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:48.566055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.566529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:48.567314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.567743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:48.682192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:48.683572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:48.691270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.691711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:48.692704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.693133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:48.720962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:48.729867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6a399067-4b9c-42ec-9243-935886b37fdb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056012 Nov 10 15:56:48.730698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 179/324] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:48 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:56:48.731444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:48.732402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:48.733605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d414d661-4d0a-43da-a254-96767c13a327 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.180485 Nov 10 15:56:48.734202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 146/325] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:56:48.895071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:48.895702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:48.902519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.902976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:48.903897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:48.904388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:49.059789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:49.068148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f89fc1da-cd90-405d-8ea4-c844c88dd07d tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.176666 Nov 10 15:56:49.068763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 180/326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:48 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:49.741051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:49.741954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:49.749513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:49.749950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:49.750799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:49.751240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:49.752719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:49.753386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:49.760282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:49.760736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:49.761554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:49.761980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:49.783536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3dfe234-9ea7-4250-bb2b-a662ec786a17 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Nov 10 15:56:49.784125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 147/327] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:49 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:49.927970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:49.939834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:49.941867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:49.943935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4bbafdd8-eb0a-4b71-b83a-10c9b7128cfe tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.194446 Nov 10 15:56:49.943935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 181/328] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:56:50.085932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:50.086593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:50.094077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.094552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:50.095379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.095804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:50.255321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:50.265250 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c85c4a6e-4a09-4a07-a00e-4e7df5e5298f tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.183050 Nov 10 15:56:50.265846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 148/329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:50 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:50.795079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:50.796661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:50.803638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.804314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:50.806086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.806680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:50.870700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e08d7080-0ad9-41e3-9342-578420a2bb7e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069487 Nov 10 15:56:50.870700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 182/330] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:50 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:50.968884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:50.969668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:50.981397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.981907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:50.982736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:50.983327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.248956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:51.259940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:51.262065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:51.263304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-528552ae-26d9-4a3c-9f23-e25b3ebdd80c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.300248 Nov 10 15:56:51.263892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 149/331] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:51.293247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:51.294337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:51.303581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:51.304057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.304897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:51.305332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.527570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:51.557209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1102ebb6-4d68-45d4-88b7-c5c6348752f3 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.268705 Nov 10 15:56:51.558180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 183/332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:51 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:51.785453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-9aec9131-104f-427a-a155-cfb05f61f233 req-86a9ba36-e305-40a2-896f-6ad6b9de11ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24fbe7e-4415-408a-b418-059d3d639472", "name": "network-vif-plugged", "status": "completed", "tag": "d4c6bf00-4827-4fff-85a1-3a94863e38e0"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:51.787004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:51.787004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:56:51.795167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-9aec9131-104f-427a-a155-cfb05f61f233 req-86a9ba36-e305-40a2-896f-6ad6b9de11ad service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:51.795605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-9aec9131-104f-427a-a155-cfb05f61f233 req-86a9ba36-e305-40a2-896f-6ad6b9de11ad service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.809006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-9aec9131-104f-427a-a155-cfb05f61f233 req-86a9ba36-e305-40a2-896f-6ad6b9de11ad service nova] Creating event network-vif-plugged:d4c6bf00-4827-4fff-85a1-3a94863e38e0 for instance a24fbe7e-4415-408a-b418-059d3d639472 on hv-cinder-81708 Nov 10 15:56:51.814301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-9aec9131-104f-427a-a155-cfb05f61f233 req-86a9ba36-e305-40a2-896f-6ad6b9de11ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Nov 10 15:56:51.815146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 150/333] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:51.879204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:51.881399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:51.888463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:51.889533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.890446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:51.891102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:51.927037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-de5f6896-39b2-49fc-9c35-33f6016c2676 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053391 Nov 10 15:56:51.927644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 184/334] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:51 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:52.286821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:52.287481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:52.294558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.295022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.295868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.296300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.456076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:52.464974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:52.466504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:52.467906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-acf98dc5-df73-49a8-8210-7d78024d40b6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.186382 Nov 10 15:56:52.468445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 151/335] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:52 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:52.576221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:52.576943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:52.582982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.583411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.584226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.584645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.775258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:52.783879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2066a2bb-9da7-4794-a594-07a0c693f2ac tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.211541 Nov 10 15:56:52.784703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 185/336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:52 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:52.939896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:52.940678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:52.947494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.947945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.948863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:52.949184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:52.985628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cc7a76b6-4de6-47cb-b830-f7984fecb6da tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049853 Nov 10 15:56:52.986318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 152/337] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:52 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:56:53.488098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:53.488713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:53.495222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:53.495725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:53.496688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:53.497125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:53.634133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:53.644862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:53.646942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:53.648276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1d40b468-4d90-4bc5-9384-8e679aa96136 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.165402 Nov 10 15:56:53.649092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 186/338] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:53.801352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:53.801966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:53.809448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:53.809745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:53.810615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:53.811057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:53.985800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:53.999838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ecb3a249-0df0-4356-9b79-8782c55ce64c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1313 microversion: 2.1 time: 0.201727 Nov 10 15:56:54.000855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 153/339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:53 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:54.005814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:54.007061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:54.016232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:54.016823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:54.017759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:54.018308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:54.052882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5ced8dbc-ab2c-4fd7-a10c-5f6518108a89 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055761 Nov 10 15:56:54.053679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 187/340] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:53 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:54.669625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:54.670324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:54.677395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:54.677848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:54.678660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:54.679094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:54.868355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:54.880005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:54.882905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:54.885206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-14a446a1-6966-464f-8dd6-0a846729afcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1722 microversion: 2.20 time: 0.219357 Nov 10 15:56:54.887512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 154/341] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:55.018463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:55.019308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:55.026503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.027043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:55.027908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.028321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:55.063491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:55.064411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:55.070871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.071305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:55.072097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.072538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:55.109461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4614b4f2-c4f3-4437-bb84-bbb8925dbac0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049716 Nov 10 15:56:55.110045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 155/342] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:55 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:56:55.192257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:55.200691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8dee7e28-f0fe-401d-8239-1103361ca9dd tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1496 microversion: 2.1 time: 0.185895 Nov 10 15:56:55.201274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 188/343] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:55 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:55.911258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:55.911839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:55.919165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.919165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:55.919875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:55.920315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.029576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:56.030201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:56.038519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.039001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.040047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.040757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.071123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 15:56:56.167472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:56.197473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:56.199758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-71c020ef-9a41-4c36-9093-365e57563b7c tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 204 len: 0 microversion: 2.1 time: 0.174214 Nov 10 15:56:56.206688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:56.206688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e242fd35-2db3-4310-be6b-3eacfaf955ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1743 microversion: 2.20 time: 0.296584 Nov 10 15:56:56.206688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 156/344] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1743 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:56.215194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 189/345] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 15:56:56 2021] DELETE /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:56:56.218232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:56.223384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:56.234680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.236063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.237452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.238068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:56.239012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:56.239589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.255935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.256380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.257173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:56.257598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:56.310906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cf88fbe5-244e-4dd3-a1ba-bfc475376768 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104966 Nov 10 15:56:56.312773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 157/346] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:56 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:56.492719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:56.502398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1bb9b31a-6515-40ee-9c92-3e5d17f1bcee tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1502 microversion: 2.1 time: 0.268158 Nov 10 15:56:56.503268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 190/347] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:56 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:57.221816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:57.222797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:57.229492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.230124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.231077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.231599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.346194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:57.346194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:57.400190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.400927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.402479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.403228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.424237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:57.432761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:57.436416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:57.437563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-39fb6852-3ea1-49ed-bc2f-1e3c93ae0f4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1743 microversion: 2.20 time: 0.219594 Nov 10 15:56:57.438112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 158/348] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:56:57.491937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-41358116-9005-4f57-9689-5ab9775fd8a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169007 Nov 10 15:56:57.494639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 191/349] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:57 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:57.531034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:57.532629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:57.540628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.541258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.542033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.543535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.664656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-3e5e5a79-6fd5-4ca1-9a00-b06e49720b46 req-4bae7a69-df3d-4ab7-996b-fbff65a4f82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "name": "network-vif-plugged", "status": "completed", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:57.667020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:57.667020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:57.687024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-3e5e5a79-6fd5-4ca1-9a00-b06e49720b46 req-4bae7a69-df3d-4ab7-996b-fbff65a4f82f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:57.687974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-3e5e5a79-6fd5-4ca1-9a00-b06e49720b46 req-4bae7a69-df3d-4ab7-996b-fbff65a4f82f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:57.707618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-3e5e5a79-6fd5-4ca1-9a00-b06e49720b46 req-4bae7a69-df3d-4ab7-996b-fbff65a4f82f service nova] Creating event network-vif-plugged:d1fb9f0b-735b-4033-978f-e1637c0ce284 for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa on hv-cinder-81708 Nov 10 15:56:57.715921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:57.724253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-18edb275-cd37-4d58-bad2-a4b05d8766ec tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1502 microversion: 2.1 time: 0.197818 Nov 10 15:56:57.730069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-3e5e5a79-6fd5-4ca1-9a00-b06e49720b46 req-4bae7a69-df3d-4ab7-996b-fbff65a4f82f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070092 Nov 10 15:56:57.731469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 192/350] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:56:57.734628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 159/351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:57 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:58.194396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:58.195849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:58.202810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.203264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.204073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.204506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.241766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lazy-loading 'flavor' on Instance uuid f732db3a-a74d-4503-8538-9bcb4136479a {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:56:58.459158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:58.461511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:58.462960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2796c608-a0e4-45bd-bb6a-d559cdcf01bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action" status: 200 len: 32 microversion: 2.1 time: 0.270681 Nov 10 15:56:58.465365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 193/352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 15:56:58 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 15:56:58.475219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.476491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.479552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.480899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.490458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:58.491248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:58.504721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.505692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.507077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.507921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.898681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:58.905686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:58.914361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:58.915894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:58.917093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6308f0f2-9f0c-4b0e-80c2-551dbe3139ec tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1743 microversion: 2.20 time: 0.464613 Nov 10 15:56:58.917685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 160/353] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:58 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1743 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:56:58.922096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9903828e-9fa3-4ba8-a685-c722d5ebf791 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.445726 Nov 10 15:56:58.924597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 194/354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:58.932109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:58.933063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:58.944045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:58.945181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:58.945984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.946535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.947373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.947806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.980007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.980422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:58.981364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:58.981807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:59.014256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d0ab1401-1c42-4d33-b3aa-07306919d1d8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095396 Nov 10 15:56:59.015145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 161/355] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:56:58 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 15:56:59.231508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cdb673ba1f417b8cc0734ad38ed57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20ca518d4ee447b3b7ad79544ec13e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:56:59.249614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-529517367", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "dcfba35b-5a66-47f5-96dc-9f6b79831f53"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:59.250309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-89cbcb65-f01f-43c8-9e0c-47e56bd13846 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 200 len: 1502 microversion: 2.1 time: 0.312530 Nov 10 15:56:59.251522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 195/356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:56:58 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:56:59.471172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] validate_networks() for [('dcfba35b-5a66-47f5-96dc-9f6b79831f53', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:56:59.608475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-a3ca6b97-93d1-4248-9073-e0f51e65f9ab req-44cf9f5f-a192-4552-a7ca-ad70c238af58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24fbe7e-4415-408a-b418-059d3d639472", "name": "network-vif-deleted", "tag": "d4c6bf00-4827-4fff-85a1-3a94863e38e0"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:56:59.610869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:56:59.610869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:56:59.639859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a3ca6b97-93d1-4248-9073-e0f51e65f9ab req-44cf9f5f-a192-4552-a7ca-ad70c238af58 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:59.640316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a3ca6b97-93d1-4248-9073-e0f51e65f9ab req-44cf9f5f-a192-4552-a7ca-ad70c238af58 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:59.665366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-a3ca6b97-93d1-4248-9073-e0f51e65f9ab req-44cf9f5f-a192-4552-a7ca-ad70c238af58 service nova] Creating event network-vif-deleted:d4c6bf00-4827-4fff-85a1-3a94863e38e0 for instance a24fbe7e-4415-408a-b418-059d3d639472 on hv-cinder-81708 Nov 10 15:56:59.672188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-a3ca6b97-93d1-4248-9073-e0f51e65f9ab req-44cf9f5f-a192-4552-a7ca-ad70c238af58 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066991 Nov 10 15:56:59.673535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 196/357] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:56:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:56:59.936887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:56:59.937890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:56:59.946570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:59.947023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:56:59.948013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:56:59.948723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.242096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:00.257194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:00.262863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:57:00.262863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:57:00.262863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:57:00.262863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:57:00.262863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:57:00.268454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:00.272702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d671d6ce-a4e5-498c-a233-0f194166f2ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.339476 Nov 10 15:57:00.275031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 197/358] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:56:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:00.283261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.284102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.285157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.285769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.285963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:00.287356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:00.302670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.310068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.312588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.313550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.317882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:57:00.324744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for user d50d9103fa7d4f74bd77defac782f225 and project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:57:00.340538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:57:00.343408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:57:00.439956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e6a41b9f-f9ca-4994-9650-15e1aa4ecf08 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195501 Nov 10 15:57:00.442011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 162/359] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:56:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:57:00.457184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-532301192", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:00.599058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:00.611649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f2c0fee4-2be4-4162-843e-cee95e7c813c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.334861 Nov 10 15:57:00.612250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 198/360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:00.617080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:00.617806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] [instance: a24fbe7e-4415-408a-b418-059d3d639472] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:00.633145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.633711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.634572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:00.635105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:00.675240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] HTTP exception thrown: Instance a24fbe7e-4415-408a-b418-059d3d639472 could not be found. Nov 10 15:57:00.675866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] Returning 404 to user: Instance a24fbe7e-4415-408a-b418-059d3d639472 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:57:00.676714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-219ed499-ca6c-41d2-80fe-89850f158935 tempest-VolumesActionsTest-1788691186 tempest-VolumesActionsTest-1788691186-project] 10.222.0.60 "GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472" status: 404 len: 111 microversion: 2.1 time: 0.063484 Nov 10 15:57:00.677653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 199/361] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:00 2021] GET /compute/v2.1/servers/a24fbe7e-4415-408a-b418-059d3d639472 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:00.682576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-035fe359-1a76-43a7-afef-81a25d39e09a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:00.689269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-035fe359-1a76-43a7-afef-81a25d39e09a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:00.795352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-035fe359-1a76-43a7-afef-81a25d39e09a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:00.803873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-035fe359-1a76-43a7-afef-81a25d39e09a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1217 microversion: 2.1 time: 0.125509 Nov 10 15:57:00.804879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 200/362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:01.311542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:01.315304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:01.333608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:01.334694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:01.336648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:01.337804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:01.640261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:01.661599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:01.665269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:01.667813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-954b8100-500c-4774-ab20-c8adccda2a36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.377595 Nov 10 15:57:01.669582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 201/363] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:01.678814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:01.680368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:01.700967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:01.702471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:01.706869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:01.708288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:02.014647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:02.029341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d33a1812-aa15-45dc-b53d-a1db4415b764 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.357182 Nov 10 15:57:02.030478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 202/364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:02.056732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:02.058335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:02.068430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:02.069483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:02.071148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:02.072142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:02.199406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:02.208871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7e77219e-ca97-4e0a-af0c-e5a26c81a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1269 microversion: 2.1 time: 0.161052 Nov 10 15:57:02.209794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 203/365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:02.705081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:02.707979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:02.756547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:02.768920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:02.770950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:02.772283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:03.105534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:03.121769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:03.123840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:03.126028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a99b8400-11b5-4804-94b3-465bc0b9cbe7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.431954 Nov 10 15:57:03.127366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 204/366] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:02 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:03.136161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:03.137334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:03.145917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:03.146852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:03.151164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:03.152539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:03.541938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:03.557911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75f728ab-b461-42ba-8bfc-67ad98bfeca8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.429178 Nov 10 15:57:03.558594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 205/367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:03.564593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:03.566491 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:03.578009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:03.578480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:03.579357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:03.579811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:03.665437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:03.679136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-93212e26-6931-42f3-a514-add34245f269 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1275 microversion: 2.1 time: 0.119305 Nov 10 15:57:03.679916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 206/368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:04.152303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:04.153162 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:04.159994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:04.160436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:04.161232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:04.161672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:04.455237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:04.481035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:04.485011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:04.487786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c131c174-e05b-464a-8c8a-73406fbfa6d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.342093 Nov 10 15:57:04.489478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 207/369] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:04.578592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:04.579574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:04.592640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:04.593406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:04.594424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:04.595064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:04.917133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:04.934467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fe52ada2-48d8-4d9e-91a4-a2ec8d0a2cb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.357816 Nov 10 15:57:04.936808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 208/370] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:04.948076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-93f949ee-ad35-4fc0-8b8c-8a44543ad02d req-02499eae-4ea1-4ff4-8609-508d8cb75bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da545b27-f196-4505-9b6b-c2cf256f84b9", "tag": "46843532-4859-472a-8809-3b25ce7a2743"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:04.950127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] validate_networks() for None {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 15:57:04.953940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:04.953940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:57:04.969230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-93f949ee-ad35-4fc0-8b8c-8a44543ad02d req-02499eae-4ea1-4ff4-8609-508d8cb75bd0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:04.970561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-93f949ee-ad35-4fc0-8b8c-8a44543ad02d req-02499eae-4ea1-4ff4-8609-508d8cb75bd0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.001947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-93f949ee-ad35-4fc0-8b8c-8a44543ad02d req-02499eae-4ea1-4ff4-8609-508d8cb75bd0 service nova] Creating event network-changed:46843532-4859-472a-8809-3b25ce7a2743 for instance da545b27-f196-4505-9b6b-c2cf256f84b9 on hv-cinder-81708 Nov 10 15:57:05.013445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-93f949ee-ad35-4fc0-8b8c-8a44543ad02d req-02499eae-4ea1-4ff4-8609-508d8cb75bd0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073554 Nov 10 15:57:05.015135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 209/371] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:05.025402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:05.038192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:05.074555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.086646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.097377 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.098804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.703210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 15:57:05.704608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 15:57:05.706246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 15:57:05.707109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 15:57:05.707718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 15:57:05.720953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.722533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.725521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.726207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.731706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:05.745554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-47431b6a-fb2f-4d40-a351-fc3cbc901781 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.728101 Nov 10 15:57:05.746311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 210/372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:05.754029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Getting quotas for project 65d800b461854d12b3c94a486da8922c. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 15:57:05.760321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Getting quotas for user 8982620a6c8a43958f911e44dda83783 and project 65d800b461854d12b3c94a486da8922c. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 15:57:05.760598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:05.761976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:05.770088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.770559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.771365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:05.772155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:05.779372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 15:57:05.783318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 15:57:05.853064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b826d910-8ba1-408a-971c-a5e96171751d tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.409596 Nov 10 15:57:05.862482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 163/373] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 15:57:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 5419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 15:57:05.878673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4648f04f-3c4e-4a91-a59c-cd2ceb349a74 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:05.879600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4648f04f-3c4e-4a91-a59c-cd2ceb349a74 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:05.988389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4648f04f-3c4e-4a91-a59c-cd2ceb349a74 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:05.999629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4648f04f-3c4e-4a91-a59c-cd2ceb349a74 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1214 microversion: 2.1 time: 0.135038 Nov 10 15:57:06.000211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 164/374] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:05 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:06.020719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:06.021411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:06.037379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:06.037840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:06.038719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:06.039162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:06.046016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:06.056187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:06.063555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:06.064840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-546cc24c-38d9-4833-bd78-23acd17349d8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.308508 Nov 10 15:57:06.065671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 211/375] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:06.309061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:06.348244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1be048f7-7afb-4984-bbd5-2019c570865c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.342575 Nov 10 15:57:06.361923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 165/376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:06.767272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:06.768546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:06.776993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:06.777467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:06.778347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:06.778780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:06.982603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:06.993122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ca4734de-b2e9-4475-824e-221beb07c150 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.231114 Nov 10 15:57:06.994004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 212/377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:07.019240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:07.020777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:07.029650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.030379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.032031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.032798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.083733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:07.084727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:07.101465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.103873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.106986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.108136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.112648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:07.131511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1db58cfe-2bd2-48c1-8220-5eb9d0b6c533 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1218 microversion: 2.1 time: 0.116911 Nov 10 15:57:07.132873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 166/378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:07 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:07.318456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:07.333735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:07.336494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:07.337802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c454e376-e7e9-4c99-8fdf-71026bb40440 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.257965 Nov 10 15:57:07.338621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 213/379] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:07.372610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:07.373711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:07.383940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.384384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.385184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:07.385614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:07.655712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:07.668050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f4fdbb9-194f-4fe7-80e3-e840efef3a13 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.303441 Nov 10 15:57:07.669027 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 167/380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:08.013794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:08.015743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:08.023276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.024055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.025234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.025861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.153917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:08.155894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:08.168039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.169402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.171135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.174414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.300034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:08.318201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-403243cb-b729-4d09-b52a-c7bfe7247332 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.310123 Nov 10 15:57:08.320065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 214/381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:08.331907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:08.349693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5d4ba64b-4639-4a39-8f85-06b3d2428503 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1218 microversion: 2.1 time: 0.203795 Nov 10 15:57:08.351457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 168/382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:08 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:08.384323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:08.385944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:08.397495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.398270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.399557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.400174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.672085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:08.691484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:08.692416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:08.695599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:08.699245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:08.705638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9101e02f-19ed-4e11-b28d-beb0b8eb7b29 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.328177 Nov 10 15:57:08.706625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 215/383] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:08 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:08.716382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.717226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.718418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:08.719053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:08.993549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.005141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-79b01d23-3499-49bd-aa23-b6f548452c20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.319386 Nov 10 15:57:09.006060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 169/384] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:09.350046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:09.350706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:09.372375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.372908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.373784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.375688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.383809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:09.384910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:09.399510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.400406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.411180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.412004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.653508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.671869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c249ed4c-f2ad-4a55-a4b3-8a141142d0ce tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1284 microversion: 2.1 time: 0.294529 Nov 10 15:57:09.673531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 170/385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:09 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:09.733327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:09.734867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:09.748231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.749704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.750669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:09.751279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:09.820183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.831613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6108a383-7b8f-4060-8645-38cdd1ab8aa1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.496712 Nov 10 15:57:09.832206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 216/386] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:09.951820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.969227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.970979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:09.972835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-443de52a-d4f0-4174-8775-87c582dd7167 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.249894 Nov 10 15:57:09.973692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 171/387] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:09 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:10.025453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:10.027000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:10.050791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.051809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:10.052984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.054040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:10.299651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:10.312117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a701868c-d1aa-470a-82bb-9e62b84e9e00 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.292608 Nov 10 15:57:10.314555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 217/388] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:10.701637 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:10.703475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:10.724703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.725557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:10.726690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.727299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:10.849942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:10.850850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:10.865268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.865719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:10.867652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:10.868107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:11.255960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:11.267246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-583496a0-9581-4379-8456-6fd05584b074 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.570675 Nov 10 15:57:11.268508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 172/389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:10 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:11.273618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:11.274504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:11.305939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:11.307638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:11.310828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:11.312257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:11.318921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:11.337585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32ed4401-80bd-4a2b-a60a-dce57ea683a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.487878 Nov 10 15:57:11.339621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 218/390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:11.346692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:11.347682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:11.357757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:11.358660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:11.359673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:11.360316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:11.811007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:11.831030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-690be36b-6e24-458f-b9bb-db9dca6a5d98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.489723 Nov 10 15:57:11.831995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 219/391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:12.044884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:12.094741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:12.102787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:12.108254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-702d6fc6-d72b-49e9-ab2c-dd77b397f89d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.837893 Nov 10 15:57:12.137208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 173/392] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:12.291666 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:12.292787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:12.308308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.316303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.317421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.317912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.364553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:12.367834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:12.392726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.393969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.396920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.404835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.835039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:12.860257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8a376cf2-fb43-43ed-b707-fb76131a03fa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.505586 Nov 10 15:57:12.881914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 174/393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:12.898685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:12.899675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:12.912231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.914185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.924274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:12.933698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:12.935291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:12.957324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c881633a-d4d4-4974-aa8f-6e36a2f78681 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.670601 Nov 10 15:57:12.975877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 220/394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:12 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:13.022212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-b4762781-9543-4b65-91a0-cb23a4b00271 req-fde1ca19-323a-4369-8bd2-687a0105a560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e77054-56ce-4bd0-b782-6882152b8a56", "tag": "5665efc7-6d3d-4d44-b38d-e431814a8799"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:13.029589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:13.029589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:57:13.077449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b4762781-9543-4b65-91a0-cb23a4b00271 req-fde1ca19-323a-4369-8bd2-687a0105a560 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:13.081630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b4762781-9543-4b65-91a0-cb23a4b00271 req-fde1ca19-323a-4369-8bd2-687a0105a560 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:13.175906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-b4762781-9543-4b65-91a0-cb23a4b00271 req-fde1ca19-323a-4369-8bd2-687a0105a560 service nova] Creating event network-changed:5665efc7-6d3d-4d44-b38d-e431814a8799 for instance 27e77054-56ce-4bd0-b782-6882152b8a56 on hv-cinder-81708 Nov 10 15:57:13.197123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-b4762781-9543-4b65-91a0-cb23a4b00271 req-fde1ca19-323a-4369-8bd2-687a0105a560 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184852 Nov 10 15:57:13.203338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 221/395] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:13.225552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:13.227367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:13.254061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:13.257979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:13.259502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:13.260291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:13.475436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:13.490886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7f591392-e7a5-49fe-a754-d83adcab6327 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.609807 Nov 10 15:57:13.491694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 175/396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:13.596499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:13.605769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:13.607545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:13.614472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-641b505a-a866-4e70-a831-0592fd6a9fd7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1738 microversion: 2.20 time: 0.408658 Nov 10 15:57:13.615500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 222/397] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:13.892058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:13.898049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:13.923904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:13.924710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:13.926288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:13.926974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:13.989777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:13.990422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:14.002243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.002846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:14.004150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.004919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:14.202803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:14.223780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb4b02da-2fc2-40de-9c37-941819f7e231 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.341263 Nov 10 15:57:14.226866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 176/398] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:14.237217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:14.247456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-798098da-1803-445c-a7eb-b747cc270d55 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.261391 Nov 10 15:57:14.251132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 223/399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:13 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:14.508133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:14.509556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:14.521203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.522077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:14.523211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.523936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:14.636704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:14.641667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:14.654742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.655504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:14.656881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:14.660959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.104761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:15.115888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-44a411d4-1b5a-4c3f-9b0a-dfb891f11ab0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.611726 Nov 10 15:57:15.117059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 177/400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:15.123686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "233ae01f-7234-4402-8838-38907392ce67", "device": "/dev/sdb"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:15.126408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:15.135113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.135888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.140103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:15.150812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.152544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.159060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:15.160687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:15.161927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aaf4fedb-8cdb-47d8-ad5c-1dd9633cf455 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1720 microversion: 2.20 time: 0.530290 Nov 10 15:57:15.162925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 224/401] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1720 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:15.259898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:15.264060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:15.294241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.294998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.296027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.296767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.585115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7e1698be-d6cf-4232-a953-684266a8235f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "POST /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466610 Nov 10 15:57:15.586807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 178/402] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:57:15 2021] POST /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:15.613868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:15.615054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:15.647510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.650130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.658688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:15.659947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:15.972358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:15.981301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1c3f185f-b1a5-42a8-96f4-09e18df924e4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.740149 Nov 10 15:57:15.992254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 225/403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:16.046793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:16.060829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-82b16aa7-c644-4664-a7f1-67b6d99ab7d6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.472425 Nov 10 15:57:16.061782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 179/404] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:15 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:16.138995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:16.139480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:16.151089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:16.154443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:16.158512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:16.159673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:16.182393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:16.183846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:16.195055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:16.195978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:16.197392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:16.198646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:16.513073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:16.525830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:16.527553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:16.528744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96eacbaf-fba8-4021-b29f-12ce6f19311f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1720 microversion: 2.20 time: 0.351450 Nov 10 15:57:16.529661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 180/405] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1720 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:16.533392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:16.548729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4e5349d3-13b4-43c0-ad07-bd256a7b8d8d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.413057 Nov 10 15:57:16.559561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 226/406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:17.001488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:17.003069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:17.017358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.018564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.020064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.021186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.080073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:17.087240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:17.096808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.097275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.098345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.098942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.304172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.313294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ba20aa4e-feb2-40eb-9662-4a11c81fd48e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.317306 Nov 10 15:57:17.324910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 181/407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:17.340681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.348109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a96be298-c9c6-4d6d-82e8-d6c435f570f7 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.273015 Nov 10 15:57:17.350194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 227/408] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:17 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:17.549089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:17.549940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:17.560353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.561070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.570449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:17.571361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:17.573588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.579279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.581963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.585178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.587611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.592553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.862428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.873879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.877474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.881848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c63469b9-87c1-47f2-85d0-8977b8252470 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1720 microversion: 2.20 time: 0.337305 Nov 10 15:57:17.894076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 182/409] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1720 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:17.894076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-d894049f-1928-4d2c-9853-ea68a8e30610 req-7616b92e-c13e-46ca-b41c-b2fa73866fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da545b27-f196-4505-9b6b-c2cf256f84b9", "name": "network-vif-plugged", "status": "completed", "tag": "46843532-4859-472a-8809-3b25ce7a2743"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:17.894076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:17.894076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:57:17.904153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:17.917948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eae56d63-2f54-4ac9-a813-61ed423c3469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.351435 Nov 10 15:57:17.918732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 228/410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:17.921100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d894049f-1928-4d2c-9853-ea68a8e30610 req-7616b92e-c13e-46ca-b41c-b2fa73866fb5 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:17.921796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d894049f-1928-4d2c-9853-ea68a8e30610 req-7616b92e-c13e-46ca-b41c-b2fa73866fb5 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:17.940718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-d894049f-1928-4d2c-9853-ea68a8e30610 req-7616b92e-c13e-46ca-b41c-b2fa73866fb5 service nova] Creating event network-vif-plugged:46843532-4859-472a-8809-3b25ce7a2743 for instance da545b27-f196-4505-9b6b-c2cf256f84b9 on hv-cinder-81708 Nov 10 15:57:17.946337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-d894049f-1928-4d2c-9853-ea68a8e30610 req-7616b92e-c13e-46ca-b41c-b2fa73866fb5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061957 Nov 10 15:57:17.947713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 183/411] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:18.337309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:18.338458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:18.346748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.347576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.348706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.349387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.368321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:18.369029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:18.389588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.390298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.391669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.392100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.541532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:18.555949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9eee7883-7d93-421f-93f7-2af7377adb25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.226200 Nov 10 15:57:18.557064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 229/412] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:18.631029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:18.640047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1335719e-5ce1-4776-a9ee-97036846489f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.276777 Nov 10 15:57:18.651316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 184/413] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:18 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:18.904501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:18.905280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:18.936088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:18.936881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:18.953454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.955836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.957884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.957884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.958703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.962087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:18.963337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:18.963933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:19.202749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.206466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.212871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e9a7335c-bb28-4c58-a4a8-c294302e48cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.280726 Nov 10 15:57:19.213465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 185/414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:19.224173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.226327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.227812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b4ac3948-21cf-4c30-b106-6b24dee4b230 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1720 microversion: 2.20 time: 0.330698 Nov 10 15:57:19.238829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 230/415] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1720 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:19.575141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:19.576852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:19.593898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:19.599967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:19.601242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:19.602517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:19.661634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:19.663722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:19.675012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:19.675827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:19.677007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:19.677724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:19.888288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.904719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-71b1ff4a-6882-474a-a957-9aafdede9af1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1317 microversion: 2.1 time: 0.335113 Nov 10 15:57:19.915583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 186/416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:19.968040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-a4dccea7-85d7-48f2-b9de-5238136619ea req-b23e171e-7ad3-42b0-b3eb-4bc16e39c980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "name": "network-vif-unplugged", "status": "completed", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:19.969445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:19.970533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:19.970533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:57:19.982036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b86bf048-7d05-4cfa-8ac7-a14cc67a8d1b tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.325887 Nov 10 15:57:19.983053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 231/417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:19 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:19.989383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-a4dccea7-85d7-48f2-b9de-5238136619ea req-b23e171e-7ad3-42b0-b3eb-4bc16e39c980 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:19.990018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-a4dccea7-85d7-48f2-b9de-5238136619ea req-b23e171e-7ad3-42b0-b3eb-4bc16e39c980 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.006335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.compute.server_external_events [req-a4dccea7-85d7-48f2-b9de-5238136619ea req-b23e171e-7ad3-42b0-b3eb-4bc16e39c980 service nova] Unable to find a host for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa. Dropping event network-vif-unplugged {{(pid=115911) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 10 15:57:20.007662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-a4dccea7-85d7-48f2-b9de-5238136619ea req-b23e171e-7ad3-42b0-b3eb-4bc16e39c980 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045423 Nov 10 15:57:20.008350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 187/418] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:19 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 10 15:57:20.231477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:20.232153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:20.238754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.239297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.240140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.240733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.251705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:20.253655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:20.264279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.265088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.266492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.267122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.490023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:20.501795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-31d03b22-3c8f-4813-b4b8-6ca9c1590888 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.273838 Nov 10 15:57:20.503853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 232/419] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:20.505493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:20.515436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:20.517368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:20.518817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-da8cfbe5-8646-4ee1-90ed-c2a0daa8bdf9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1663 microversion: 2.20 time: 0.275433 Nov 10 15:57:20.519505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 188/420] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1663 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:20.538682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cd31d72-058e-429f-b1da-c137b8a15d9f"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:20.540416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:20.549440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.549891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.551392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.552099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.939270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:20.942854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:20.956172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.957221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.958625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:20.959339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:20.960717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-91879507-6d66-432b-96b4-b59fda45dc55 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.427612 Nov 10 15:57:20.966720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 233/421] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Nov 10 15:57:20 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments => generated 188 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 15:57:21.002114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:21.003056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:21.015179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.015621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.018417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.018800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.252446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.267127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3dff49d3-1e03-41e0-9f81-9c940c1a1f92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1507 microversion: 2.1 time: 0.338082 Nov 10 15:57:21.268033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 189/422] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:21.273277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:21.274238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:21.281948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.282556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.283186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.283988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.378916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.395717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e5a7d2ba-2e41-41c8-b166-b33b6c788cf9 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.398424 Nov 10 15:57:21.398050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 234/423] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:20 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 15:57:21.479520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7bf6ffd2-eaa0-4ee7-826a-2c2bb8158e2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action" status: 202 len: 0 microversion: 2.20 time: 0.210105 Nov 10 15:57:21.480929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 190/424] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 15:57:21 2021] POST /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:57:21.492285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:21.494452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:21.506911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.507517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.508422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.509424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.520728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:21.521336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:21.533277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.533628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.534535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:21.534985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:21.929808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.950464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.954191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.955653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9c69bac3-01e6-464b-8a72-ff2874019ac5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1749 microversion: 2.20 time: 0.470340 Nov 10 15:57:21.971162 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 235/425] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:21 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1749 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:21.979770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:21.997190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0fc3d856-e113-4579-ba7b-1c4d1c8a2206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.480785 Nov 10 15:57:21.998629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 191/426] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:22.028542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-81d49501-fb0c-4038-8b85-8aac95cb7951 req-e1ecc653-31df-4b85-bff3-0dcfe16289c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e77054-56ce-4bd0-b782-6882152b8a56", "name": "network-vif-plugged", "status": "completed", "tag": "5665efc7-6d3d-4d44-b38d-e431814a8799"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:22.031028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:22.031028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 15:57:22.039825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-81d49501-fb0c-4038-8b85-8aac95cb7951 req-e1ecc653-31df-4b85-bff3-0dcfe16289c3 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:22.040745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-81d49501-fb0c-4038-8b85-8aac95cb7951 req-e1ecc653-31df-4b85-bff3-0dcfe16289c3 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:22.062750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-81d49501-fb0c-4038-8b85-8aac95cb7951 req-e1ecc653-31df-4b85-bff3-0dcfe16289c3 service nova] Creating event network-vif-plugged:5665efc7-6d3d-4d44-b38d-e431814a8799 for instance 27e77054-56ce-4bd0-b782-6882152b8a56 on hv-cinder-81708 Nov 10 15:57:22.071727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-81d49501-fb0c-4038-8b85-8aac95cb7951 req-e1ecc653-31df-4b85-bff3-0dcfe16289c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047131 Nov 10 15:57:22.073132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 236/427] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:22.424402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:22.427086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:22.451444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:22.459136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:22.461285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:22.463989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:22.777089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:22.809881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d34e70ee-1d9d-496d-9ffd-43c65be689e6 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.395006 Nov 10 15:57:22.810774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 192/428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:22 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:22.831409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c62f1d-97e9-4499-9960-ccabe445351b"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:22.833593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:22.842674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:22.843966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:22.845060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:22.845851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:22.982410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:22.989056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:23.006120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.006587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:23.011578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.012353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:23.222344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:23.233043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:23.234949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:23.236361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-473c7c97-032a-4c7b-8530-e7c7f0d58ef7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1749 microversion: 2.20 time: 0.263700 Nov 10 15:57:23.237317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 193/429] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1749 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:23.263096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:23.264377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:23.271475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.271930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:23.272783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.273216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:23.331387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2b6a4bdf-c3a1-4ca0-a19d-93bb5d93e0a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504237 Nov 10 15:57:23.333576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 237/430] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:57:22 2021] POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:23.539371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:23.548613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4756ff02-eec5-4d2d-8f42-0708598a235b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.290541 Nov 10 15:57:23.555474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 194/431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:23.834297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:23.835392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:23.842848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.846863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:23.849934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:23.852501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:24.056490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:24.065157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f1095ea3-7a66-4af4-a981-11444e6b3ff4 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1314 microversion: 2.1 time: 0.235050 Nov 10 15:57:24.065869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 238/432] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:23 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:24.256293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:24.257109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:24.265119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:24.265931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:24.266991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:24.267584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:24.499880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:24.513758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:24.516506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:24.518311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4dd69ca7-8b5d-49bd-86d9-97b3d6acb728 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.265745 Nov 10 15:57:24.535827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 195/433] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:24.576285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:24.579451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:24.592436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:24.593648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:24.595349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:24.596356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:24.800086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:24.809249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d91b0d04-3954-4375-b8df-a1ce36e4ac80 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.239528 Nov 10 15:57:24.810244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 239/434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:25.084203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:25.085672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:25.093833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.094648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.095616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.096287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.271769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:25.292644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7d627e65-4438-447b-b668-39a7e9040137 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1463 microversion: 2.1 time: 0.212648 Nov 10 15:57:25.294224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 196/435] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:25 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1463 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:25.346947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:25.347769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:25.360476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.361518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.362931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.363774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.403292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 15:57:25.551093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:25.562623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:25.581276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.583030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.585470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.587356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.589648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-575524e3-75c5-4094-a473-e5fd3290510f tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 204 len: 0 microversion: 2.1 time: 0.247435 Nov 10 15:57:25.591030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 240/436] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 15:57:25 2021] DELETE /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 15:57:25.621756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:25.622285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:25.643488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.650679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:25.653160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:25.654094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:26.001323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:26.009256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c19e9df8-0340-4809-ad3d-675c4988d64e tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1469 microversion: 2.1 time: 0.405035 Nov 10 15:57:26.014561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 241/437] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:25 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:26.019387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:26.020008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:26.038551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:26.039023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:26.039831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:26.040272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:26.044077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:26.091498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:26.093205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:26.094517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6db2e807-2bda-414a-bc1c-c72ff44841d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.556049 Nov 10 15:57:26.109233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 197/438] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:26.242435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:26.257066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a8726f9d-29b8-451f-93c9-84cb5eb2a775 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.239447 Nov 10 15:57:26.257748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 242/439] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:27.032657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:27.035148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:27.045556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.046349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.047977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.048755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.125830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:27.126758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:27.139262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.139262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.139262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.139719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.291776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:27.303161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c9075024-6728-473c-b684-11f0d3886b09 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1469 microversion: 2.1 time: 0.278091 Nov 10 15:57:27.303767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 198/440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:27 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:27.324131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:27.325064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:27.332163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.332932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.333935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:27.334563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:27.464080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:27.473041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:27.474577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:27.475759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53c4b9d3-cfc9-4c55-8862-90a5166fbf6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.354428 Nov 10 15:57:27.476324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 243/441] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:27.567567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:27.584043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7e9c8e80-8765-4877-a21a-f93906225adb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.276728 Nov 10 15:57:27.585139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 199/442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:28.328132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:28.331583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:28.362573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.363344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.364354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.364975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.443686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-77fba7f1-6b97-42de-a8aa-ca458dc9b81b req-949aecc0-491c-4de8-b4f2-135e7cacf6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e77054-56ce-4bd0-b782-6882152b8a56", "name": "network-vif-deleted", "tag": "5665efc7-6d3d-4d44-b38d-e431814a8799"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:28.455994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:57:28.455994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 15:57:28.513574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-77fba7f1-6b97-42de-a8aa-ca458dc9b81b req-949aecc0-491c-4de8-b4f2-135e7cacf6d0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.515155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-77fba7f1-6b97-42de-a8aa-ca458dc9b81b req-949aecc0-491c-4de8-b4f2-135e7cacf6d0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.560862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-77fba7f1-6b97-42de-a8aa-ca458dc9b81b req-949aecc0-491c-4de8-b4f2-135e7cacf6d0 service nova] Creating event network-vif-deleted:5665efc7-6d3d-4d44-b38d-e431814a8799 for instance 27e77054-56ce-4bd0-b782-6882152b8a56 on hv-cinder-81708 Nov 10 15:57:28.561549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8982620a6c8a43958f911e44dda83783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d800b461854d12b3c94a486da8922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:28.579902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-77fba7f1-6b97-42de-a8aa-ca458dc9b81b req-949aecc0-491c-4de8-b4f2-135e7cacf6d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145104 Nov 10 15:57:28.580968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e48d433c-c9d6-4ca8-9aa1-a27efe779387 tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 200 len: 1427 microversion: 2.1 time: 0.258962 Nov 10 15:57:28.582245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 244/443] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:28 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:28.591135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:28.592788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:28.600078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 200/444] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 15:57:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:28.614886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:28.615605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:28.617740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.618593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.622521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.623102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.636394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.636919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.637803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:28.638268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:28.986466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:28.994999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b47062bb-86ae-460c-a146-6b573c7dc4d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.384098 Nov 10 15:57:28.995851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 201/445] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:29.046491 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:29.060813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:29.070381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:29.071846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-523b1e85-feb5-4223-b2bc-0a0596ea8205 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.487849 Nov 10 15:57:29.086075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 245/446] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:28 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:29.613006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:29.614879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] [instance: 27e77054-56ce-4bd0-b782-6882152b8a56] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:29.622892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:29.623751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:29.625159 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:29.625835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:29.643517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] HTTP exception thrown: Instance 27e77054-56ce-4bd0-b782-6882152b8a56 could not be found. Nov 10 15:57:29.644521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] Returning 404 to user: Instance 27e77054-56ce-4bd0-b782-6882152b8a56 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:57:29.645907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c873e01-536c-482a-8ad6-d200032e644a tempest-VolumesNegativeTest-976816340 tempest-VolumesNegativeTest-976816340-project] 10.222.0.60 "GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56" status: 404 len: 111 microversion: 2.1 time: 0.037320 Nov 10 15:57:29.646603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 202/447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:29 2021] GET /compute/v2.1/servers/27e77054-56ce-4bd0-b782-6882152b8a56 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 10 15:57:30.018872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:30.021159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:30.033402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:30.034448 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:30.035969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:30.036745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:30.096092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:30.096696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:30.113232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:30.113663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:30.114714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:30.115330 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:30.341391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:30.360427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9238baaf-82f9-4b03-9bc6-d090b266fd73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.349633 Nov 10 15:57:30.361474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 246/448] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:30.501396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:30.514673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:30.518422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:30.522004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-042532ac-8db5-42a5-b44c-edc04d3c765d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.430694 Nov 10 15:57:30.523351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 203/449] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:31.392699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:31.393886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:31.404929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:31.405482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:31.406874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:31.407604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:31.557187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:31.559163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:31.572224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:31.573534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:31.575050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:31.575660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:31.767179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:31.785299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6667b8da-06d5-484c-a3f1-43d55008bacf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.401328 Nov 10 15:57:31.787266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 247/450] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:31.918848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:31.928284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:31.929775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:31.931046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2670b007-39ad-4a5c-ac81-6b646883355c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.382552 Nov 10 15:57:31.932551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 204/451] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:32.804116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:32.805264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:32.813457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:32.814125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:32.815382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:32.815881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:32.954889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:32.956214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:32.963307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:32.964443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:32.965282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:32.965707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:32.968559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:32.985840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b4bf5c93-71ad-45b4-959a-745440210a73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.185448 Nov 10 15:57:32.987677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 248/452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:33.123821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:33.133010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:33.134796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:33.136584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0755fb31-b1ff-471e-b5c8-b84a48724348 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.185748 Nov 10 15:57:33.137190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 205/453] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:34.004982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:34.005604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:34.012704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.013212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.014180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.014683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.167796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:34.168656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:34.175623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:34.177584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.178104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.179116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.179541 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.185622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e7fe6b03-c4d1-4d26-aade-c57fed869dcf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1546 microversion: 2.1 time: 0.184328 Nov 10 15:57:34.186293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 249/454] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:34.208572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:34.209112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:34.215792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.216248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.217065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.217498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.303834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] HTTP exception thrown: Cannot 'detach_volume' instance f732db3a-a74d-4503-8538-9bcb4136479a while it is in vm_state rescued Nov 10 15:57:34.304449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Returning 409 to user: Cannot 'detach_volume' instance f732db3a-a74d-4503-8538-9bcb4136479a while it is in vm_state rescued {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:57:34.305303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5179409-6ef8-4bb4-a141-72bf29d6ece9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments/e7bdfbe6-efb7-4bf3-965b-0044f8279be8" status: 409 len: 152 microversion: 2.1 time: 0.104499 Nov 10 15:57:34.305894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 250/455] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 15:57:34 2021] DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments/e7bdfbe6-efb7-4bf3-965b-0044f8279be8 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 10 15:57:34.315789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:57:34.316398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:34.323716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.324184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.325017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.325453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.345825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:34.357266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:34.359661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:34.361333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-096609a4-af45-4608-98fa-c8dae2a36bb2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.198473 Nov 10 15:57:34.362554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 206/456] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:34 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:34.416173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3bd32e68-68d9-42b1-9262-dc171f8db930 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action" status: 202 len: 0 microversion: 2.1 time: 0.104791 Nov 10 15:57:34.417078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 251/457] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 15:57:34 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 10 15:57:34.434925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:34.436074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:34.447583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.448473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.450127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:34.450937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:34.971584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:34.983693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8dea3dcf-cbb9-4424-abc3-4335b76cddee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1554 microversion: 2.1 time: 0.556098 Nov 10 15:57:34.984343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 207/458] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1554 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:35.380792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:35.381520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:35.390081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:35.390549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:35.391360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:35.391897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:35.569466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:35.579524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:35.581023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:35.582196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-919cc572-4298-4fa1-a360-3b09a97a8e96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.206000 Nov 10 15:57:35.582802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 252/459] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:35 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:36.003517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:36.006407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:36.011243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:36.011693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:36.012482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:36.012979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:36.167079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:36.175713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-49275cbf-5cb7-475b-9db2-6b3031993dc9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1554 microversion: 2.1 time: 0.177411 Nov 10 15:57:36.176293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 208/460] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:36.601791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:36.602455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:36.609512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:36.609939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:36.610801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:36.611227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:36.753890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:36.762632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:36.764065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:36.765197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-651d7f7c-3c33-402b-a496-ceea24604531 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.167816 Nov 10 15:57:36.765766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 253/461] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:37.193410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:37.194003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:37.201423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.201866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.202695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.203127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.361054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:37.369984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0ce3f556-2fc7-4f9e-9780-3efed8d1b853 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1560 microversion: 2.1 time: 0.180442 Nov 10 15:57:37.370783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 209/462] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 15:57:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 15:57:37.444897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:37.445322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:37.452488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.452932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.453724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.454190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.554497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lazy-loading 'services' on Instance uuid f732db3a-a74d-4503-8538-9bcb4136479a {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:57:37.670224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-76803e8d-c2b9-4c56-b9bb-00cffb9bdd58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments/e7bdfbe6-efb7-4bf3-965b-0044f8279be8" status: 202 len: 0 microversion: 2.1 time: 0.229448 Nov 10 15:57:37.671142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 254/463] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 15:57:37 2021] DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments/e7bdfbe6-efb7-4bf3-965b-0044f8279be8 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:57:37.680108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:37.681069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:37.690096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.690875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.692228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.692972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.731560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c0bbf590-174e-439b-8d9b-ef9b19f83d38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055134 Nov 10 15:57:37.732059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 210/464] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:37.788382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:37.789623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:37.801109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.809664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.809664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:37.809664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:37.973931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:37.980436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:37.982018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:37.983240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-21e02db9-6b1b-4130-8367-c4dce2007996 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.202777 Nov 10 15:57:37.983807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 255/465] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:38.745830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:38.746796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:38.753502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:38.753962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:38.754798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:38.755234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:38.787454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a8d27f5f-8bfe-4c10-9aaf-cb23a4baebd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046272 Nov 10 15:57:38.788066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 211/466] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:39.001754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:39.002395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:39.009247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:39.009690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:39.010617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:39.011085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:39.156980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:39.166197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:39.167980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:39.169181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0cd11109-b6e9-4b1e-affa-b4c289200bce tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171234 Nov 10 15:57:39.169756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 256/467] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:39.799545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:39.800488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:39.807460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:39.807897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:39.808685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:39.809115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:39.841758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b65eef04-a00c-41f9-91aa-e77564fedc21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Nov 10 15:57:39.842379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 212/468] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:40.189113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:40.189718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:40.196608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:40.197047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:40.197844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:40.198289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:40.346191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:40.355646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:40.357358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:40.358639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-88e1dd1b-7f73-4698-a50e-3078f50022e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173361 Nov 10 15:57:40.359262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 257/469] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:40 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:40.853639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:40.854837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:40.861659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:40.862072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:40.862887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:40.863319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:40.896142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f186ff23-08fc-4de3-be89-ffffea7812dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 Nov 10 15:57:40.896731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 213/470] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:41.377830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:41.378568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:41.386096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:41.386584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:41.387391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:41.387823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:41.535446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:41.544442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:41.545937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:41.547150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-655ebb4d-1204-4afc-ae3c-d02ab73b539e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173333 Nov 10 15:57:41.547714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 258/471] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:41 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:41.908366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:41.909278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:41.916551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:41.917005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:41.917815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:41.918285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:41.949855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c37e975c-d21b-4a57-8ea6-6e635d316939 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Nov 10 15:57:41.950674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 214/472] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:42.569132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:42.570311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:42.582523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:42.583341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:42.584748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:42.585528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:42.732430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:42.741314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:42.742895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:42.744106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e329c18e-1027-4070-8cc6-8d2e7243404d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179065 Nov 10 15:57:42.744837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 259/473] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:42.961551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:42.962504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:42.969200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:42.969641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:42.970475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:42.970902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:43.001738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dd182322-a3f6-40df-a17f-6746747bcb98 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Nov 10 15:57:43.002331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 215/474] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:43.763159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:43.763791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:43.770800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:43.771277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:43.772043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:43.772473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:43.914398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:43.923932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:43.925479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:43.926729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-76acf846-b1ec-4eb9-874d-66bcfb9cc0de tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.167443 Nov 10 15:57:43.927273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 260/475] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:44.013696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:44.014659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:44.021771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:44.022245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:44.023038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:44.023455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:44.059387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1f68cc6b-8018-41b1-9ae8-ff6f3db7410f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049636 Nov 10 15:57:44.060149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 216/476] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:44.946243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:44.946945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:44.954029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:44.954587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:44.955403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:44.955854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:45.072238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:45.074460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:45.082685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:45.083265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:45.084370 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:45.085111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:45.123776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9a00daa-52fd-473b-8751-c9eecebe5bab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054171 Nov 10 15:57:45.124625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:45.128276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 217/477] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:57:45.142366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:45.145275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:45.147543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b1aba7a3-eeda-4e43-8065-0d266c22a6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.204962 Nov 10 15:57:45.148592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 261/478] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:46.135828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:46.136744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:46.143316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:46.143749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:46.144550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:46.144971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:46.179842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:46.180829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:46.186264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-35b36fd6-9dc3-4ed5-ae6f-768fd146e8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054272 Nov 10 15:57:46.187626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 218/479] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:46.188320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:46.188827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:46.189738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:46.190322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:46.348490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:46.358302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:46.359862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:46.361002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-116f18ad-f173-4d85-91f8-f911f5213877 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.184965 Nov 10 15:57:46.361782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 262/480] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:46 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:47.199101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:47.200076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:47.206914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:47.207355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:47.208153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:47.208583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:47.243653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9a1eab4-5ace-43e2-8c44-ae2aa9f1033c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 Nov 10 15:57:47.244709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 219/481] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:47.388678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:47.389445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:47.396606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:47.397053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:47.397857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:47.398370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:47.583231 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:47.592778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:47.594274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:47.595453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-77fa055a-d1ba-4fe6-b475-0d0509cee8a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.219019 Nov 10 15:57:47.596002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 263/482] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:48.263471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:48.264965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:48.276574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:48.277398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:48.278927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:48.279726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:48.336155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0fb28632-1a24-424c-bb02-d9da98bc2c8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081144 Nov 10 15:57:48.337162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 220/483] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:48.616498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:48.617108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:48.624402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:48.624850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:48.625664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:48.626061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:48.775202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:48.784792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:48.786326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:48.787514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1d4d4d41-f9f9-4352-8268-eba8f3e648b7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176113 Nov 10 15:57:48.788126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 264/484] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:49.349000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:49.349914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:49.357054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:49.357497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:49.358363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:49.358801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:49.393160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e403119-b0af-41fa-a931-810e4467315e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047886 Nov 10 15:57:49.394048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 221/485] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:49.807984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:49.808610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:49.815420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:49.815860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:49.816688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:49.817133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:49.961501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:49.974881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:49.976892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:49.978104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8eaced99-5fbf-4fd6-94e9-a687b98b65fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.174300 Nov 10 15:57:49.978733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 265/486] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:57:50.405279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:50.406628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:50.413720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:50.414267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:50.415131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:50.415691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:50.450549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b7ea7dfc-8073-4055-85a9-d572588ba6e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049175 Nov 10 15:57:50.451146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 222/487] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:50.996950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:50.997844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:51.004731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:51.005211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:51.006031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:51.006565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:51.157421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:51.166462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:51.168007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:51.169203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ad2ae5bd-f2a7-4fae-98e1-c58c5c56dba7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176288 Nov 10 15:57:51.169779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 266/488] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:51.465670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:51.466599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:51.473647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:51.474117 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:51.474927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:51.475357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:51.506189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8927170b-52cd-41ee-ba9b-f6751d6d337b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Nov 10 15:57:51.506806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 223/489] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:52.191020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:52.191681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:52.202369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:52.202840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:52.203716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:52.204174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:52.383388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:52.394978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:52.397827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:52.399247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0d35567a-12ad-40a8-91ba-381cccf8aebc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.212413 Nov 10 15:57:52.399794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 267/490] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:52 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:52.518848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:52.519770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:52.528121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:52.528872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:52.530035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:52.530867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:52.573533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-966c2288-93da-48b9-ab94-766855e5a7c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058248 Nov 10 15:57:52.574134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 224/491] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:53.418643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:53.419238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:53.426423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:53.426871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:53.427677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:53.428111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:53.585755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:53.586832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:53.590244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:53.596406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:53.596909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:53.597780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:53.598236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:53.607819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:53.613826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:53.614209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6bf33127-154c-4850-8ffa-b455d042386d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.199538 Nov 10 15:57:53.615200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 268/492] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:53.634768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-488dad15-de3a-4d75-914a-6f11ec237752 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053310 Nov 10 15:57:53.635683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 225/493] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:54.633098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:54.633799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:54.640605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:54.641049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:54.642101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:54.642393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:54.647523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:54.648727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:54.656776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:54.657344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:54.658499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:54.659100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:54.700175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-379a12bc-79d3-4828-9d86-1fa3055d9058 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055840 Nov 10 15:57:54.702237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 226/494] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:54.811399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:54.821251 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:54.823228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:54.824590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ef374308-6aff-4129-b9a6-28b29d475e6e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.195357 Nov 10 15:57:54.825100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 269/495] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:55.715394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:55.716352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:55.723477 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:55.723930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:55.724735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:55.725174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:55.757858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a4dde87e-14af-40f5-bf50-eaf0c7c665b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046942 Nov 10 15:57:55.758466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 227/496] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:55.845109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:55.845732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:55.855392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:55.856041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:55.857433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:55.858257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:56.030651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:56.039537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:56.041121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:56.042437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3c2c150b-a493-48d3-a6e9-e507312f8804 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.201195 Nov 10 15:57:56.043021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 270/497] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:56.770263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:56.771240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:56.778769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:56.779194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:56.779995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:56.780769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:56.833239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8468afb1-5a67-40b1-bced-b2f824bd6be2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066655 Nov 10 15:57:56.834325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 228/498] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:57.061588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:57.062193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:57.069274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:57.069746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:57.070622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:57.071059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:57.225785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:57.234615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:57.236132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:57.237307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-475d5ed2-937a-47e1-b67c-59888fd83c3a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179722 Nov 10 15:57:57.237841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 271/499] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:57.848232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:57.849278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:57.858437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:57.858437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:57.858437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:57.858437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:57.892740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a630ba48-9eb2-4978-9ffc-29da70358eea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Nov 10 15:57:57.894297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 229/500] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:58.297221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:58.298121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:58.305656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:58.306366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:58.307414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:58.308130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:58.450191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:58.458753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:58.460258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:58.461394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b2a82ae1-0343-4574-b08c-7cf891b94be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168118 Nov 10 15:57:58.462014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 272/501] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:58 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:58.911688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:58.913238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:58.920599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:58.921068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:58.921864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:58.922334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:58.956929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6825f274-ec3c-4ac7-ba45-b8a75cd35389 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053229 Nov 10 15:57:58.957560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 230/502] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:57:59.480715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:59.481310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:59.488493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:59.488959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:59.489788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:59.490258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:59.638407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:59.647222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:59.648736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:57:59.649897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e765b44b-ced2-4c06-af82-3f5f7ab36824 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173237 Nov 10 15:57:59.650494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 273/503] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:57:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:57:59.968996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:57:59.969920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:57:59.977313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:59.977811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:57:59.978709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:57:59.979142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:00.014843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-21bd7e12-d3cf-418a-8c86-6da7071579f6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049606 Nov 10 15:58:00.015434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 231/504] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:57:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:00.674824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:00.675404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:00.682983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:00.683583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:00.684511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:00.684953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:00.850642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:00.859507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:00.860988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:00.862175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4cf2369e-227f-46a4-94f4-353ba65fe6e5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.191893 Nov 10 15:58:00.862715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 274/505] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:00 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:01.028026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:01.028991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:01.038717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:01.039378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:01.040346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:01.040758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:01.072000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c2119fb-130a-4b96-941f-895f4ae4ae20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047727 Nov 10 15:58:01.072597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 232/506] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:01.885833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:01.886527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:01.894971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:01.895429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:01.896215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:01.896651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:02.047849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:02.056338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:02.057846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:02.059137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f9b81600-d070-4b1c-a52d-9ce248cd4379 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179556 Nov 10 15:58:02.059710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 275/507] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:02.084056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:02.084979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:02.092425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:02.092581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:02.093577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:02.094070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:02.127965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1a428cf0-b2c8-454d-be5f-422ec3650b86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048101 Nov 10 15:58:02.128615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 233/508] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:03.078367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:03.078997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:03.085923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:03.086411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:03.087232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:03.087725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:03.143282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:03.144299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:03.151841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:03.152948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:03.154215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:03.154867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:03.188971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-99446dc1-f739-433c-913a-d03aaf379bec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050491 Nov 10 15:58:03.193036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 234/509] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:03.248909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:03.258636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:03.260147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:03.261363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3e9f4be7-519f-4890-be71-ff1f64c00ae9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.187097 Nov 10 15:58:03.262417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 276/510] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:03 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:04.200062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:04.201852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:04.208682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:04.209122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:04.210114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:04.210579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:04.241498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b69c469f-e449-4cc2-8ca1-99c3a83e0ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Nov 10 15:58:04.242298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 235/511] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:04.279920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:04.280927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:04.288032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:04.288213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:04.289008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:04.289457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:04.438346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:04.447340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:04.448830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:04.450446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-160e8d8a-f5c4-4355-b848-e3630a6a6d50 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.174231 Nov 10 15:58:04.451050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 277/512] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:05.257310 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:05.258953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:05.270130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:05.270130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:05.270719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:05.271195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:05.303596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f18669fa-8bd8-4bf6-8dc2-a5fd68280f2f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052918 Nov 10 15:58:05.304182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 236/513] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:05.473333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:05.473875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:05.480925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:05.481637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:05.482568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:05.483023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:05.636099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:05.645096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:05.646614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:05.647770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fc73d0be-54c7-48e9-ae9e-37b306071536 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178391 Nov 10 15:58:05.648328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 278/514] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:06.316807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:06.317740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:06.329292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:06.329292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:06.329292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:06.329292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:06.362861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3ff25d31-8e1f-4ac7-8a3e-5c99a0f87c9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050066 Nov 10 15:58:06.363650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 237/515] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:06.667350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:06.667958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:06.675827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:06.676363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:06.677327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:06.677759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:06.821871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:06.835007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:06.837035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:06.838838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fb48f609-f6ae-4f4b-93d6-a79757e50e95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.175330 Nov 10 15:58:06.839712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 279/516] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:06 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:07.377616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:07.378569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:07.385567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:07.386013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:07.386897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:07.387485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:07.419633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a32e20e7-d9f0-4680-a065-f0b602af6539 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046593 Nov 10 15:58:07.420225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 238/517] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:07.858619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:07.859452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:07.866081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:07.866570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:07.867366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:07.867893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:08.008989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:08.018512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:08.020020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:08.021217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dc4d6381-7a31-42c2-9f08-428a2afe4a9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.166663 Nov 10 15:58:08.021788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 280/518] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:08.431295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:08.432763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:08.438908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:08.439346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:08.440158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:08.440581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:08.471640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b9c72968-17ea-4948-8f64-6e86ac99fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Nov 10 15:58:08.472126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 239/519] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:09.040273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:09.040955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:09.047767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:09.048218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:09.049035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:09.049469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:09.202648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:09.212317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:09.213876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:09.215078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-da628845-bfa7-40a5-baf3-0ca70a409062 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178715 Nov 10 15:58:09.215663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 281/520] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:09 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:09.484142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:09.485610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:09.503793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:09.503793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:09.503793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:09.503793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:09.534524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec412b13-e109-4581-939b-223e3c18ade2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054202 Nov 10 15:58:09.535145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 240/521] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:10.234745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:10.235440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:10.242818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:10.243272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:10.244076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:10.248124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:10.397473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:10.406931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:10.408414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:10.409575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-98f2611c-c143-46f5-bc04-c18e39ea857a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178728 Nov 10 15:58:10.410140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 282/522] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:10.546174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:10.547301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:10.554574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:10.555214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:10.555812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:10.556245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:10.587394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7abc1328-079c-4a6b-b811-f876d521612f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Nov 10 15:58:10.587982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 241/523] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:11.429049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:11.429751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:11.436407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:11.436858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:11.437875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:11.438458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:11.580957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:11.596016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:11.598542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:11.599124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:11.600075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:11.600241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-682342c0-0be3-4fd8-b8bc-436c5993f85d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.175123 Nov 10 15:58:11.600951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 283/524] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:11.607191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:11.607613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:11.608433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:11.608840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:11.640629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7f7fd92e-5eee-46cd-8e5c-d8e1db756334 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Nov 10 15:58:11.641334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 242/525] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:12.619664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:12.620273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:12.627263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:12.627719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:12.628499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:12.629129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:12.655924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:12.657956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:12.664362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:12.665051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:12.665873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:12.666320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:12.702249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-19fef606-f5d0-4dfe-95e1-7ffa3371e74a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050649 Nov 10 15:58:12.704686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 243/526] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:12.785497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:12.794523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:12.796022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:12.797261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-546b7fea-f07d-4b94-b588-b168b255992e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.181570 Nov 10 15:58:12.797823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 284/527] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:13.719007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:13.719899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:13.726870 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:13.727324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:13.728088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:13.728726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:13.759208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3e57544-17bf-4c0e-8dea-b05472f77e10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Nov 10 15:58:13.759828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 244/528] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:13.815655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:13.816415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:13.823767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:13.824409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:13.825203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:13.825653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:13.968030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:13.976970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:13.978501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:13.979680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f7ad7bfd-1967-4696-b58e-656af4dcb385 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168056 Nov 10 15:58:13.980271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 285/529] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:14.771034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:14.771854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:14.778599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:14.778827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:14.779592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:14.780383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:14.810810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f3c18c10-7649-4425-9f05-8ad771c9666e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Nov 10 15:58:14.811414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 245/530] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:14.997701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:14.998300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:15.005041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:15.005498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:15.006329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:15.006772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:15.144921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:15.154422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:15.156188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:15.157342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-92d84c05-725e-4c4d-b119-6c843caa461e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.163426 Nov 10 15:58:15.157925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 286/531] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:15.822827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:15.823782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:15.830524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:15.830972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:15.831764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:15.832193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:15.863946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5a522db5-7c88-491d-8565-6e119f07c119 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Nov 10 15:58:15.864604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 246/532] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:16.177310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:16.177877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:16.184750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:16.185198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:16.185990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:16.186627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:16.343488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:16.356097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:16.358531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:16.360203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0812547e-0f47-4755-96ab-747afe2b9c25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.187222 Nov 10 15:58:16.361202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 287/533] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:16.875364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:16.876475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:16.885468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:16.886354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:16.887946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:16.888682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:16.933007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a57bbbf9-a240-4e18-ab61-f2dc73943427 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061990 Nov 10 15:58:16.933585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 247/534] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:17.196409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 15:58:17.197009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 15:58:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 15:58:17.381349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:17.381941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:17.388894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:17.389337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:17.390110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:17.390573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:17.529542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:17.539200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:17.540734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:17.541952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d94cc362-e616-48b6-ad17-87ae8c67016b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.164848 Nov 10 15:58:17.542550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 288/535] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:17.944860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:17.945792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:17.952111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:17.952549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:17.953339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:17.953801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:17.986028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2ee461c8-4205-42da-9068-6adc630d2896 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Nov 10 15:58:17.986839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 248/536] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:18.561014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:18.561620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:18.568784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:18.569233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:18.570028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:18.570494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:18.722086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:18.734125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:18.736396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:18.737794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8fde595a-9d25-4de2-811e-3ec3081e6c30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180546 Nov 10 15:58:18.738373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 289/537] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:18.998277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:18.999183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:19.005412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:19.005822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:19.006661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:19.007115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:19.040555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c00a25f-52e3-429a-815b-f71c03e44cbb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Nov 10 15:58:19.041251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 249/538] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:19.757223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:19.757830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:19.764359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:19.764893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:19.765764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:19.766075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:19.915845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:19.924979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:19.926490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:19.927640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-351b6219-7f52-40a9-b6b3-d7548a38caaa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.174384 Nov 10 15:58:19.928195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 290/539] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:20.055194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:20.056218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:20.063087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:20.063536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:20.064419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:20.064858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:20.103906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ab641aae-44d9-46e8-b661-abb0653c0d46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052702 Nov 10 15:58:20.104475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 250/540] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:20.946531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:20.947147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:20.954315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:20.954770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:20.955816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:20.956301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.101402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:21.110001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:21.111694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:21.113089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-11ec23b0-c22e-414b-b6d8-9ce50cd2670b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.170329 Nov 10 15:58:21.113793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 291/541] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:21.120781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:21.122494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:21.128734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.129203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.130026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.130463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.162503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8f580d3a-86de-42e7-b5f1-ff8c847ab630 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050616 Nov 10 15:58:21.163075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 251/542] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:21.234042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c62f1d-97e9-4499-9960-ccabe445351b"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 15:58:21.235246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:21.241737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.242226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.243040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.243490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.325214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Invalid volume: volume 75c62f1d-97e9-4499-9960-ccabe445351b is already attached to instances: da545b27-f196-4505-9b6b-c2cf256f84b9 Nov 10 15:58:21.325848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 400 to user: Invalid volume: volume 75c62f1d-97e9-4499-9960-ccabe445351b is already attached to instances: da545b27-f196-4505-9b6b-c2cf256f84b9 {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 15:58:21.326705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-474c1827-bc56-4eb0-a093-0694a53b1261 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096670 Nov 10 15:58:21.327265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 292/543] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 15:58:21 2021] POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 10 15:58:21.385761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:21.386301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:21.393016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.393519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.394356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.394785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.534492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lazy-loading 'services' on Instance uuid da545b27-f196-4505-9b6b-c2cf256f84b9 {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 15:58:21.660193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7d331fa1-5b9c-4bae-ae98-aa58fac6576b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments/75c62f1d-97e9-4499-9960-ccabe445351b" status: 202 len: 0 microversion: 2.1 time: 0.278081 Nov 10 15:58:21.660998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 252/544] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 15:58:21 2021] DELETE /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments/75c62f1d-97e9-4499-9960-ccabe445351b => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 15:58:21.669410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:21.670384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:21.677073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.677606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.678528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:21.679065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:21.713752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d90c5603-0c03-404f-8a33-fcaa466f8919 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Nov 10 15:58:21.714327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 293/545] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:22.133162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:22.133826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:22.140300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.140698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.141484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.141907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.175643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:22.177294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:22.184350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.184800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.185601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.186036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.220534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3fbb8708-ba50-48cf-a46b-2724caf6adb5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049759 Nov 10 15:58:22.221028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 294/546] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:22.300336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:22.309256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:22.310760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:22.311913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4630f0e6-c44f-48a0-bcaf-ae9d6e9d8d73 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.183368 Nov 10 15:58:22.312464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 253/547] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:22.726323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:22.727278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:22.734456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.734917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.735703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:22.736139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:22.768244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6d1c3e87-4cbb-40e5-9975-bf26dde56277 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046153 Nov 10 15:58:22.768915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 295/548] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:23.233138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:23.234130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:23.241088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.241613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.242409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.242924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.293300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0083e985-3e3a-4022-a197-e394cb37daf2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064385 Nov 10 15:58:23.294976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 254/549] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:23.332108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:23.332707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:23.339473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.339922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.340762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.341192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.475403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:23.484451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:23.485984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:23.487637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-628e2ff9-3763-4f61-87f1-5f8a639f0e0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.159264 Nov 10 15:58:23.488198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 296/550] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:23.780606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:23.781526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:23.788688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.789262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.789906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:23.790376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:23.821103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8477f40e-033f-4b77-959c-dd57bada02b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Nov 10 15:58:23.821677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 255/551] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:24.306685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:24.307607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:24.314296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.314878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.315831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.316256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.350029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a9be389a-fc45-4222-a2a4-fe30f20c80dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Nov 10 15:58:24.351111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 297/552] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:24.509702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:24.510663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:24.520265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.520713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.521508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.521932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.689525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:24.702902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:24.705329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:24.706665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-290a28c1-cc89-446d-9727-77dc23a2b16d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.202933 Nov 10 15:58:24.707249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 256/553] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:24.833106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:24.833940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:24.840574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.841036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.841831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:24.842299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:24.872881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-39d82ceb-84da-4c02-9ff6-f434dd17603a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Nov 10 15:58:24.873492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 298/554] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:25.361948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:25.363148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:25.369636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.370084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.370905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.371344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.402391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2d446e08-ce80-4f22-b192-45eddfaf6cb0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Nov 10 15:58:25.403124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 257/555] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:25.729067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:25.730484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:25.736881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.737325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.738131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.738589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.874968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:25.884481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:25.885057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:25.885391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:25.886297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:25.887480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6b6d5030-18fa-46e3-992e-a3d051ac5a5c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.165334 Nov 10 15:58:25.888112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 299/556] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:25.896138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.896138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.896138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:25.896138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:25.926338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b344cd9-9589-4247-bcc9-1214d7c462ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Nov 10 15:58:25.926895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 258/557] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:26.418024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:26.419598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:26.428092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.428532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.429285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.429739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.460388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d25a6d24-2fde-4a16-90df-674365eb7bf1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049043 Nov 10 15:58:26.460947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 300/558] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:26.907849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:26.908468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:26.915488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.915960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.916755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.917179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.937048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:26.938015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:26.944566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.945018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.945867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:26.946343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:26.980941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2e7d0e89-bbe0-4be1-9d8f-56fedac4943c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Nov 10 15:58:26.981786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 301/559] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:27.069624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:27.082195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:27.084425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:27.086127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4e91ab2c-7668-414d-8e7d-6d3b7d037f1b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.182451 Nov 10 15:58:27.086868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 259/560] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:27.471013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:27.471947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:27.478288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:27.478758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:27.479554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:27.479996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:27.510312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7cdf7aec-679c-4883-add7-6211a63fb1e4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Nov 10 15:58:27.510892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 302/561] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:27.994705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:27.995637 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:28.002143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.002627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.003423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.003836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.036523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9aa1769-511c-491c-9040-aba86686ce22 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Nov 10 15:58:28.037142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 260/562] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:28.108515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:28.108515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:28.116961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.117573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.118609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.119257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.272743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:28.282189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:28.283675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:28.284862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a450c4bb-0072-4eb6-85b1-1dd873c5f7fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180973 Nov 10 15:58:28.285424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 303/563] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:28 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:28.520910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:28.521922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:28.528366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.528555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.529325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:28.530092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:28.564401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7ae60ff4-b24c-4d8b-8c84-6f8b0f37fd53 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 Nov 10 15:58:28.564968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 261/564] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:29.048349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:29.049283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:29.056279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.056711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.057497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.057933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.090842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a5082298-8519-41b0-9639-c73fac0affb1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Nov 10 15:58:29.091444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 304/565] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:29.304671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:29.305420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:29.314646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.315313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.316843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.317495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.459451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:29.467792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:29.469254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:29.470585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1b6f167f-8720-4123-9557-1667f57c9250 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.170633 Nov 10 15:58:29.471165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 262/566] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:29 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:29.575695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:29.576985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:29.583784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.584245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.585047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:29.585465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:29.616256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c7d0eb76-aad6-49c5-a71f-e8ad93114c7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Nov 10 15:58:29.616816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 305/567] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:30.102588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:30.103522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:30.110275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.110706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.111485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.111925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.147112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9b877a47-f3a4-499f-8e34-fab0e59d4b34 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048417 Nov 10 15:58:30.147731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 263/568] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:30.489450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:30.490152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:30.496423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.496861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.497656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.498089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.627969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:30.628440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:30.635640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.636197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.636963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:30.637372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:30.638691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:30.648821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:30.650738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:30.652076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5af26ee6-4bd0-4ddb-bef8-ae0cc9d16076 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.166355 Nov 10 15:58:30.652704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 306/569] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:30.671375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b4325272-a887-460a-a43d-27aa56cc7b0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047568 Nov 10 15:58:30.672014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 264/570] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:31.160531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:31.161587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:31.170456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.170914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.172197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.172678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.211102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-06bc6d3a-4e7c-4f58-b7cd-e4f034dd5969 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054548 Nov 10 15:58:31.211634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 307/571] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:31 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:31.671780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:31.672401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:31.679457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.679896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.680703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.681101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.682724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:31.683635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:31.691130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.691697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.692459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:31.692941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:31.724394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cbd7cea1-a775-4b1a-ba73-e0f87911a62e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Nov 10 15:58:31.728506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 308/572] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:31.825002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:31.836687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:31.838309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:31.839497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-88add739-d68a-4c24-9b0f-afb6855624a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171580 Nov 10 15:58:31.840056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 265/573] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:32.233815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:32.237203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:32.244810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.245502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:32.246546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.246991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:32.280098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-24cfb666-4923-4786-8501-da12b3321b6a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052730 Nov 10 15:58:32.281095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 309/574] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:32.735361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:32.736278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:32.745543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.746296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:32.747565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.748286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:32.783491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-23408dd3-f6b9-4e10-9d9c-d53f205dff91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052018 Nov 10 15:58:32.784119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 266/575] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:32.863454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:32.864044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:32.871076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.871521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:32.872325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:32.872759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:33.012458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:33.021088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:33.022904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:33.024199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4e268178-d41d-4abc-b6eb-48078daf68ca tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.164705 Nov 10 15:58:33.025355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 310/576] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:33.294326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:33.294326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:33.299697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:33.300148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:33.300921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:33.301363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:33.331817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6258af00-e4cf-4c86-b195-4598f4990bb6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 Nov 10 15:58:33.332360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 267/577] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:33.795295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:33.796322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:33.802740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:33.803201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:33.804019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:33.804600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:33.835629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8bb06acb-b1b6-46ae-ad43-89ef7e8c314d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Nov 10 15:58:33.836407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 311/578] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:34.044518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:34.045106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:34.051874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.052322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.053106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.053532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.199201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:34.211727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:34.213254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:34.214458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-130aff63-5459-4890-a54d-8490929d55d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173839 Nov 10 15:58:34.215025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 268/579] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:34 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:58:34.344289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:34.345368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:34.353949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.354569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.355469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.355899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.388193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-575daab0-034d-4357-8f3b-dfdd0a488aa2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047774 Nov 10 15:58:34.388769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 312/580] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:34.847203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:34.848115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:34.854486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.854937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.855717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:34.856121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:34.886681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d223628c-73ce-4499-8090-fd11f5009291 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Nov 10 15:58:34.887269 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 269/581] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:35.234089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:35.234780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:35.241740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.242208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.243579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.245464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.396018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:35.400371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:35.401274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:35.405670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:35.407241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:35.408390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-559b82d0-b30c-403e-b0a5-66cbf051636a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179003 Nov 10 15:58:35.408950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 313/582] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:35 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:35.413807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.414354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.415231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.415657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.447562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-26d56821-3b22-4deb-b95c-367622ef24cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051376 Nov 10 15:58:35.448130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 270/583] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:35.898547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:35.899601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:35.909572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.910582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.911860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:35.912676 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:35.950114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ae8d0d4b-8854-4a4e-ba8e-b0886ce3014b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055457 Nov 10 15:58:35.950708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 314/584] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:36.430207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:36.431120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:36.437890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.438516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:36.439418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.439849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:36.458735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:36.459852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:36.466621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.467062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:36.467841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.468270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:36.500956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6059e290-d2ba-492b-a0bf-902e09b57a02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Nov 10 15:58:36.501581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 315/585] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:36 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:36.584188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:36.593296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:36.594828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:36.595990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d93d551f-b2c4-46f2-baf3-4af690826146 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.169689 Nov 10 15:58:36.596548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 271/586] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:36.961334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:36.962467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:36.969086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.969551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:36.970418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:36.970938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:37.004714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cd082954-4a08-4719-8d79-ff3fcd2a6908 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047212 Nov 10 15:58:37.005406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 316/587] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:37.513933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:37.514763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:37.521179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:37.521610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:37.522410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:37.522827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:37.552190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-18caa182-1f17-4158-96ae-1be7973743f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 Nov 10 15:58:37.552721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 272/588] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:37.615296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:37.615854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:37.622678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:37.623125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:37.623948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:37.624399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:37.772648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:37.782290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:37.783824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:37.785014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-18383695-dcac-46db-bd78-4af451076e8a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173573 Nov 10 15:58:37.785565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 317/589] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:58:38.017055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:38.017972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:38.024505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.024892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.025693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.026141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.056165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-45910108-9917-4461-83be-7656a822f6b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Nov 10 15:58:38.056806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 273/590] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:38.565215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:38.566565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:38.575355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.576011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.577295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.577972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.615621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-64cba750-0724-452c-87a6-03555b90d318 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054355 Nov 10 15:58:38.616303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 318/591] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:38 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:38.804177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:38.804754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:38.811651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.812095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.812884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:38.813312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:38.979768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:38.993586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:38.995110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:38.996270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b4a21091-166f-4382-b7ca-d4abc07409e3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.195950 Nov 10 15:58:38.996817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 274/592] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:39.071691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:39.072890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:39.082222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:39.082968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:39.084033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:39.084677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:39.116929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5396c4e6-fd2a-4792-ab28-22aac28036e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050344 Nov 10 15:58:39.116929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 319/593] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:39.629517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:39.630473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:39.637847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:39.638344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:39.639344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:39.639773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:39.671971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c83a500e-2636-4a30-80b3-c8fd0f04ada7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Nov 10 15:58:39.672554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 275/594] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:40.015696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:40.016322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:40.022968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.023414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.024197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.024627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.127843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:40.128768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:40.135254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.135833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.136586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.137204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.168810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-04359c2f-e5bf-49b9-b067-051b832ea071 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Nov 10 15:58:40.169281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 276/595] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:40.176627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:40.185827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:40.187354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:40.188553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4b7dd179-113d-419e-b3cb-f0572ed0d02c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176841 Nov 10 15:58:40.189117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 320/596] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:40 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:40.685688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:40.686982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:40.696321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.696953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.698139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:40.698783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:40.730078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d4c295b0-6ec5-4703-b484-60d61f9e6350 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048937 Nov 10 15:58:40.730680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 277/597] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:41.180712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:41.181632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:41.189488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.189960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.190762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.191194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.211025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:41.212188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:41.219681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.220246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.221052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.221905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.231364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4bcef939-edc7-4be0-a2cc-abb8c68580f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054570 Nov 10 15:58:41.231948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 321/598] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:41.364668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:41.375094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:41.377495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:41.379289 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2fe10725-c559-49d3-af37-fda49ad78757 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.172416 Nov 10 15:58:41.379977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 278/599] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:41 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:41.742186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:41.743097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:41.749619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.750062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.750890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:41.751311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:41.783562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53153ed0-01e7-4001-b2f2-d1a6e6681062 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Nov 10 15:58:41.784134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 322/600] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:42.251361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:42.253014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:42.262988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.263514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.264353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.264823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.296290 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c321619-df2b-40ac-bf30-583750fd114a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056516 Nov 10 15:58:42.297374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 279/601] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:42.400571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:42.401145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:42.408778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.409242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.410035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.410512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.560022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:42.568740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:42.570272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:42.571468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b6cc88a6-7e92-4942-b572-65d1ab2510d9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176776 Nov 10 15:58:42.572023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 323/602] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:42.799434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:42.800725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:42.811885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.812554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.813436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:42.813902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:42.849569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eab79a2d-456c-47ca-b350-5af2f59814e9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056587 Nov 10 15:58:42.850144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 280/603] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:42 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:43.309718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:43.310685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:43.317249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.324426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.325387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.325832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.358959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bd3750ae-e9f1-4658-ab8a-d7dc89dedddb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053928 Nov 10 15:58:43.359439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 324/604] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:43.590796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:43.591752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:43.598803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.599242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.600033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.600478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.747085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:43.755964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:43.757423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:43.758651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-02d34810-c01c-41db-9fad-40648d14b17f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171946 Nov 10 15:58:43.759262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 281/605] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:43.861256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:43.862132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:43.868985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.869430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.870247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:43.870675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:43.902001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-179346b1-d154-4bc3-b391-013092aacdd8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Nov 10 15:58:43.902903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 325/606] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:44.372015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:44.372920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:44.379573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.380009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.381073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.381577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.417023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d3a2161a-a451-4c23-9b8c-cf3e5ef5375e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049102 Nov 10 15:58:44.417512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 282/607] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:44.778689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:44.779636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:44.786277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.786797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.787776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.788213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.915165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:44.916302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:44.924011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.924505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.925257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:44.925676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:44.936562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:44.952863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:44.955050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:44.956618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a98b8a18-8d06-464f-bf7b-f8f98f65791e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.181933 Nov 10 15:58:44.957303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 326/608] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:44.960089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-434d09ba-e777-47ca-9cde-1b9ee2f3c920 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049148 Nov 10 15:58:44.960645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 283/609] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:45.429012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:45.430390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:45.437444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.437899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:45.438732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.439174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:45.473028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-99d11669-105d-492b-8a89-809a267be8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Nov 10 15:58:45.473514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 327/610] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:45.973276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:45.974230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:45.976152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:45.976759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:45.980873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.981324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:45.982142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.982614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:45.985134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.985780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:45.986904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:45.987395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:46.019415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e4ca0f8d-79f1-4afc-8377-a1be02100e64 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050369 Nov 10 15:58:46.020382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 284/611] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:46.139813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:46.149198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:46.150719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:46.151927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5106ba8-d3f2-48dc-a7c5-ab5b314a7a42 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179549 Nov 10 15:58:46.152562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 328/612] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:45 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:46.485131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:46.486004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:46.492158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:46.492526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:46.493421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:46.493849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:46.523839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec0a1aac-63dd-4a7f-8f11-9f7d4be27054 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Nov 10 15:58:46.524406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 285/613] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:47.032571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:47.033426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:47.040214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.040700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.041493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.042001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.075031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fec3e8ae-5ceb-4529-b24b-d54994858262 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Nov 10 15:58:47.075620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 329/614] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:47 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:47.173432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:47.174016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:47.181165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.181609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.182458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.182885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.328942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:47.337427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:47.339067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:47.340530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-79c09092-908e-4324-be48-d3b224fd42e7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171527 Nov 10 15:58:47.341111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 286/615] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:47.536106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:47.537078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:47.544090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.544561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.545438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:47.545784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:47.577058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9f4c098f-bbdc-467a-bcb3-34db4777e7fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Nov 10 15:58:47.577554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 330/616] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:48.090062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:48.091042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:48.097464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.097910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.098731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.099160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.130007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f79febd1-1b20-4337-8655-d6a07ce42e46 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Nov 10 15:58:48.130609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 287/617] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:48.359779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:48.360347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:48.367147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.367591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.368367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.368792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.510414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:48.519149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:48.520670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:48.521861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44dc39ea-fdff-4edf-bc22-8f20f8d78cfc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.166199 Nov 10 15:58:48.522484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 331/618] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:48.589105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:48.590193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:48.596780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.597227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.598003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:48.598466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:48.628603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-76205c29-00a6-4173-b388-1651b7466c4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Nov 10 15:58:48.629068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 288/619] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:49.143639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:49.144551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:49.151004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.151455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.152268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.152695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.186956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-90687d5b-d60e-4eda-8cc2-7f6f6570d53c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047391 Nov 10 15:58:49.187857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 332/620] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:49.541228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:49.541829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:49.548000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.548455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.549195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.549614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.640545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:49.641581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:49.648329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.648702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.649486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:49.649924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:49.680381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73f40c60-31b7-46fb-9c85-1279727e7f22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Nov 10 15:58:49.680958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 333/621] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:49.761921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:49.772943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:49.775254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:49.776724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1160ff81-81b4-4986-8c65-f1beab4e030e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.239280 Nov 10 15:58:49.777431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 289/622] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:50.200278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:50.201205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:50.207864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.208323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.209131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.209543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.242235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b562ab19-8d43-4627-bac4-3f81ff0dc53d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046069 Nov 10 15:58:50.242235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 334/623] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:50 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:50.692410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:50.693318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:50.700570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.701047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.701872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.702335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.734369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-47ff8073-8240-443a-a644-ff569a4fa469 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Nov 10 15:58:50.735585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 290/624] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:50.796421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:50.797021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:50.803799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.804240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.805015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:50.805451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:50.959107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:50.968645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:50.970173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:50.971404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-16cbf71e-abac-4051-972a-d0b5d9eb76d1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179179 Nov 10 15:58:50.971984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 335/625] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:51.253767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:51.254685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:51.260804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.261236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:51.262522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.262929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:51.295485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-12609475-9875-4cad-aa28-5fbbe87716c9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Nov 10 15:58:51.296301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 291/626] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:51.749104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:51.750198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:51.756708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.757145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:51.757918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.758380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:51.790511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-05ab6f4d-b1f4-4e3a-8e80-e58253650a9d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Nov 10 15:58:51.790996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 336/627] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:51.990298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:51.990892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:51.997867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.998337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:51.999102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:51.999518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:52.148322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:52.157211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:52.158756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:52.159888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4c8d7a38-c5a6-4255-8166-73d868b48776 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173540 Nov 10 15:58:52.160458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 292/628] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:51 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:52.307319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:52.308718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:52.317113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:52.317631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:52.318872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:52.319502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:52.351819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a13ae192-0588-40e0-84ba-91a12d550786 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Nov 10 15:58:52.352289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 337/629] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:52.803150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:52.804109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:52.810089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:52.810576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:52.811344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:52.811760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:52.854125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f4e8367a-b46c-4ab2-b98d-aa1ac4cb7e84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055124 Nov 10 15:58:52.854698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 293/630] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:53.181441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:53.182241 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:53.190667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.191118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.191905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.192340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.346520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:53.355128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:53.356792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:53.357996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1de72534-43f7-4927-bbbb-c08046eb0edb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.182632 Nov 10 15:58:53.358848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 338/631] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:53.363759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:53.364912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:53.371081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.371510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.372703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.373277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.405761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dad24e4d-b386-4881-86df-a779be7e5720 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Nov 10 15:58:53.409732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 294/632] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:58:53.869457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:53.870418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:53.877606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.878051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.878889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:53.879320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:53.913392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ba402d81-3af3-4d62-a5a4-9fc8823c9008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047571 Nov 10 15:58:53.913888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 339/633] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:54.377948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:54.378581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:54.387344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.387790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.388572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.389400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.417481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:54.418940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:54.429101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.429564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.430456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.430819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.473942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bec07d35-f529-49a8-8284-911d52ed24f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054826 Nov 10 15:58:54.473942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 340/634] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:54 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:54.558843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:54.568620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:54.570082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:54.571264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56712404-4db6-48ab-9120-657fc7186716 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.198161 Nov 10 15:58:54.571811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 295/635] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:54.928779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:54.929605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:54.936265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.936714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.937506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:54.937943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:54.969437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dfda2818-a11e-4b09-b59d-4a7541bc678a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047980 Nov 10 15:58:54.970006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 341/636] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:55.480608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:55.481524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:55.488860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.489296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:55.490084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.490553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:55.522539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-22073a32-11e0-491d-a685-71c2c8c279b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Nov 10 15:58:55.523006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 296/637] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:55 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:55.595266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:55.595899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:55.601928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.602413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:55.603222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.603649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:55.742822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:55.751836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:55.753341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:55.754577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a3cc74db-e655-4dc0-994e-2620b300866e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.164114 Nov 10 15:58:55.755169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 342/638] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:55.980967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:55.981884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:55.988579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.989046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:55.989814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:55.990294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:56.020887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eac80614-e603-49b2-87df-d5ef158520f4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Nov 10 15:58:56.021463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 297/639] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:56.535059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:56.535971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:56.542601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:56.543057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:56.543860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:56.544296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:56.576238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-79d9432f-99d8-426b-b0dc-698ad5e668d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Nov 10 15:58:56.576809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 343/640] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:56.773580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:56.774209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:56.781901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:56.782386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:56.783182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:56.783615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:56.940434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:56.949566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:56.951080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:56.952299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-70be4d70-9570-4b87-bdf0-483e9ab75840 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.182557 Nov 10 15:58:56.953177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 298/641] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:56 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:57.033087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:57.034053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:57.041111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.041564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:57.042401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.042827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:57.074619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1fc740bc-c677-4be5-8d26-9343ffb44043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Nov 10 15:58:57.075303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 344/642] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:57.588847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:57.589799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:57.597666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.598116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:57.598975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.599394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:57.631751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b205aa2b-2d75-4da8-8c69-9b3e5ffe475a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Nov 10 15:58:57.632318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 299/643] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:57.975294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:57.975958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:57.982432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.982878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:57.984056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:57.984550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:58.087989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:58.089087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:58.097487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:58.097952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:58.098953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:58.099408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:58.132438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f091b010-96e1-44d7-a119-2eab02417de8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048193 Nov 10 15:58:58.132886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 300/644] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:58.145560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:58.157981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:58.160288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:58.162026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e2faccb0-4c65-478c-82c1-004a6c373c5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.190432 Nov 10 15:58:58.162850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 345/645] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:58.645755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:58.646718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:58.653342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:58.654096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:58.654916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:58.655430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:58.686206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cbc6cd52-c439-4ac3-ae00-24c6ac68d5d1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Nov 10 15:58:58.686787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 301/646] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:59.144848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:59.145819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:59.153026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.153508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.154711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.155157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.183478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:59.184040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:59.186274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d745ac0f-aefd-476b-8f75-f615a29fde62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Nov 10 15:58:59.187095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 346/647] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:58:59.190858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.191314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.192100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.192535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.337298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:59.346673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:59.348157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:58:59.349308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-93917eb7-9a9d-4aaa-9d7b-03d13c378458 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.169623 Nov 10 15:58:59.349863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 302/648] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:58:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:58:59.699284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:58:59.700252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:58:59.707136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.707586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.708404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:58:59.708845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:58:59.742119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1afbb0cf-3c25-4895-9a93-c104ffb4df20 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046662 Nov 10 15:58:59.742775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 347/649] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:58:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:00.199779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:00.200694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:00.208093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.208528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.209316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.209756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.242475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3a3f45f1-679e-4c09-ba49-c9d07d0d32e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Nov 10 15:59:00.243228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 303/650] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:00.368441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:00.369041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:00.375588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.376038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.376843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.377274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.519751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:00.529631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:00.531392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:00.532593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ed91b183-2481-4049-bb1b-e8ec501750b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168235 Nov 10 15:59:00.533164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 348/651] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:00 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:00.754521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:00.755425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:00.761859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.762328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.763081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:00.763532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:00.795427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c44e3e36-39c1-45c3-907f-d0e94aec2632 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Nov 10 15:59:00.795934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 304/652] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:01.259093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:01.260020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:01.267328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.267781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.268584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.269021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.303892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44089283-8ba9-46cd-81e5-81cb27a153e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048896 Nov 10 15:59:01.304756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 349/653] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:01.553804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:01.554510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:01.563286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.563727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.564542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.564974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.708998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:01.718850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:01.720448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:01.721650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1385f519-b49a-4b5e-905d-5a39a396d449 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173382 Nov 10 15:59:01.722228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 305/654] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:01.807450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:01.808271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:01.815643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.816082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.816881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:01.817323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:01.849285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aed54dc1-3159-4ea3-8873-20b3ee12fb06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Nov 10 15:59:01.849864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 350/655] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:02.318579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:02.319387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:02.325663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.326098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.326905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.327583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.359619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b02e7c0-ecdb-4de4-8957-808fac31bf0f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Nov 10 15:59:02.360475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 306/656] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:02.740114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:02.740721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:02.747235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.747683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.748466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.748888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.861232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:02.862225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:02.868891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.870067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.870221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:02.870596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:02.892354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:02.903146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:02.904634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06314f80-8d2b-48e0-a335-b53d316ce1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046806 Nov 10 15:59:02.905646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 307/657] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:02.905852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:02.907585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73938304-0a3d-412e-b59a-65c334d382c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171175 Nov 10 15:59:02.908384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 351/658] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:02 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:03.371740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:03.372594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:03.379834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.380298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.381084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.381481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.414784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-264bc423-d1b2-4d11-a029-5d5b8a8e3807 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Nov 10 15:59:03.415380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 308/659] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:03.918186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:03.919150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:03.926625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:03.927218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.927365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:03.927518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.928393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.928810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.934661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.935254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.936190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:03.936604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:03.965042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c22ba7eb-b973-4a46-8de0-8025810222f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051093 Nov 10 15:59:03.966102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 352/660] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:04.080393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:04.089169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:04.090691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:04.091876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8248e1e2-e898-4b58-aaf5-58242e8fded6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.169175 Nov 10 15:59:04.092437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 309/661] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:03 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:59:04.426313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:04.427434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:04.434387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:04.434850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:04.435660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:04.436090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:04.471754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-76317a1d-5ba2-4b1d-9efa-c1311d22afeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049482 Nov 10 15:59:04.472349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 353/662] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:04.979800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:04.980714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:04.987446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:04.987879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:04.988747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:04.989081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:05.020445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5958981f-91fa-4c98-897b-c27e6032a116 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Nov 10 15:59:05.021011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 310/663] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:05.111402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:05.112033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:05.119148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:05.119651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:05.120474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:05.120953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:05.276121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:05.285621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:05.287159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:05.288379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0bb04bf2-bc62-426a-9fff-342e7eee952a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180890 Nov 10 15:59:05.288940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 354/664] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:05.486724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:05.487822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:05.494649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:05.495099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:05.495893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:05.496306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:05.529609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-49a97608-5e83-478e-ac47-f317f2e5fe67 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Nov 10 15:59:05.530231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 311/665] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:06.033193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:06.034100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:06.040688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.041124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.041941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.042415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.073987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fd6329c9-f3ab-4d7f-b652-76d2e716c79b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Nov 10 15:59:06.074609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 355/666] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:06.318273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:06.318951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:06.326198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.326647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.327713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.328378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.510640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:06.520226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:06.521963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:06.523342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8e5b8075-6735-43d4-aeda-1920f8eaa4b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.210124 Nov 10 15:59:06.524044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 312/667] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:06 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:06.545532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:06.546494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:06.553898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.554372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.555208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:06.555646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:06.603234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-50d59036-7fdb-4f6b-b4a2-a53de9b9ae4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061671 Nov 10 15:59:06.603850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 356/668] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:07.085905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:07.086861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:07.093584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.094189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.095007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.095438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.128380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4ce02841-90f1-4497-ac3f-de6c1a161544 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Nov 10 15:59:07.128962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 313/669] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:07.543510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:07.544097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:07.555457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.556111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.556682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.557110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.615339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:07.616102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:07.623212 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.623659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.624718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:07.625156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:07.658299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f773f3f9-cc8e-4ac0-8778-a4f8cd89dc02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Nov 10 15:59:07.658894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 314/670] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:07.894147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:07.904138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:07.906191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:07.907999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3fd1c56f-77d7-41c9-9c29-8e3bcb8b8d3d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.368560 Nov 10 15:59:07.908668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 357/671] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:08.140411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:08.141408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:08.148090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.148532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:08.149320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.149761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:08.184618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0b47efdf-a551-4c0d-8bc7-402d929b561b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048105 Nov 10 15:59:08.185218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 315/672] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:08.673270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:08.674379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:08.681531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.681981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:08.683096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.683589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:08.716332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f5d307bc-298f-42b3-9cdc-1e68ddff4854 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048961 Nov 10 15:59:08.716840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 358/673] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:08.927407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:08.927986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:08.936369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.936877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:08.937752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:08.938260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:09.083917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:09.092739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:09.094244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:09.095559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-86d35ee6-eb14-42d6-98f9-936ccb7f8e40 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.172028 Nov 10 15:59:09.096149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 316/674] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:08 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:09.198646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:09.199493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:09.206971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:09.207434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:09.208207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:09.208632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:09.243554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-341df51a-e5c9-4a39-81c2-a962cddc7828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049012 Nov 10 15:59:09.244756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 359/675] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:09.730140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:09.730977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:09.737714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:09.738252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:09.738996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:09.739403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:09.773811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d83352ae-d38b-42b5-8eaf-4acd546b9ef9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047956 Nov 10 15:59:09.774458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 317/676] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:10.117319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:10.117928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:10.125993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.126508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.127402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.127861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.258431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:10.259752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:10.269834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.270288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.271130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.271560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.274406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:10.286617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:10.288452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:10.289963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a59900bb-6375-434f-9733-0e65fc680fcd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178072 Nov 10 15:59:10.290713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 360/677] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:10.317857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-15317779-6513-4ea0-83ef-4896474dbbdf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063616 Nov 10 15:59:10.318620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 318/678] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:10.786781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:10.787640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:10.794705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.795168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.795966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:10.796405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:10.827067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3cbd3bda-4f60-4457-adbd-ef74e7046f19 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Nov 10 15:59:10.827654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 361/679] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:11.310612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:11.311283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:11.318094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.318580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.319355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.319769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.329667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:11.331517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:11.338563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.339039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.339828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.340265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.372108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bef1015a-37a4-44b5-b824-15e7bf57a37a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Nov 10 15:59:11.372736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 362/680] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:11.472509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:11.481612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:11.483314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:11.484457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-feae37c2-2980-4f86-8577-bc46d56d3d07 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.177768 Nov 10 15:59:11.485066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 319/681] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:11.839256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:11.840093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:11.847352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.847805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.848591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:11.849023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:11.881949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7e5fd029-7a49-433b-9529-f746e3438428 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Nov 10 15:59:11.882564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 363/682] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:12.385311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:12.386436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:12.393837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.394315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.395110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.395536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.429609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e04508e7-3f02-4436-956b-9e9571f183b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Nov 10 15:59:12.430231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 320/683] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:12.504129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:12.504694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:12.511350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.511806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.512618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.513179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.657169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:12.666630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:12.668122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:12.669316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f8c7bd83-d9fd-41c5-b176-2a994ca429c8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.169699 Nov 10 15:59:12.669927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 364/684] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:12.895331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:12.896279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:12.903196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.904052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.904959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:12.905389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:12.937360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ada7ae89-d780-45bf-a4b8-6ec9dddf4ae8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Nov 10 15:59:12.937924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 321/685] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:13.441824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:13.442828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:13.449390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.449843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.450660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.451105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.481556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-755acf87-fe0b-4631-81e5-36af5ae7b681 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044100 Nov 10 15:59:13.482112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 365/686] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:13.688276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:13.688904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:13.695196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.695770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.696445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.696863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.836300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:13.845196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:13.846869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:13.848051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5e33cf0b-c43b-4193-8bc5-a890fdab1c2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.163523 Nov 10 15:59:13.848794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 322/687] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:13.949252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:13.950062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:13.956823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.957246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.958017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:13.958481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:13.990743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8d4478ca-178b-4424-bf99-099053dd5dba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Nov 10 15:59:13.991293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 366/688] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:14.496854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:14.497672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:14.506780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:14.507304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:14.508391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:14.509023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:14.542878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fbf231aa-41b9-4e4a-b390-6b3379d1048f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051762 Nov 10 15:59:14.543462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 323/689] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:14.867070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:14.868782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:14.875300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:14.875732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:14.876518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:14.876949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:15.005640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:15.006698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:15.012906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:15.013340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:15.014390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:15.014814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:15.026975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:15.036411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:15.038005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:15.039209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1a084a84-a666-469b-a48e-02c68255394b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176388 Nov 10 15:59:15.039760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 367/690] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:15.046723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9eb52746-772e-4ee6-9913-a16b88b560bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Nov 10 15:59:15.047295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 324/691] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:15.555474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:15.556451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:15.563293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:15.563843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:15.564897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:15.565344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:15.602788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fdab453a-6fd3-4ccb-94f4-f77635ba7710 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051522 Nov 10 15:59:15.603360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 368/692] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:16.058321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:16.058929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:16.059322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:16.059896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:16.066652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.067030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.067173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.067779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.068164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.068607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.069211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.069897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.100297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-03d45eaa-2028-4295-acce-1a0d40d1f8ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Nov 10 15:59:16.100885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 369/693] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:16.209017 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:16.218266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:16.219763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:16.220931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-314fc117-18ec-4018-9e45-46c9f6f05f2d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.166523 Nov 10 15:59:16.221493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 325/694] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:16.615423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:16.616346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:16.622999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.623431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.624235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:16.624668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:16.656015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b4c2045c-f21b-46f6-baf7-89bab436bd39 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Nov 10 15:59:16.656577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 370/695] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:17.112300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:17.113251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:17.120486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.120895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.121775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.122149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.154542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b23cf64f-a7b9-46fb-83d2-2848a8ac34ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Nov 10 15:59:17.155097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 326/696] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:17.240181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:17.240941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:17.248224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.249308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.249560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.249877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.394092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:17.403885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:17.405373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:17.406558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-70d5186d-42c5-41c8-9a4d-63af1d08968c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.170610 Nov 10 15:59:17.407240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 371/697] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:17.673295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:17.674335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:17.684343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.684877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.686106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:17.687061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:17.722981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cbf2945d-977d-4045-862e-8cd556f0cdf9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055847 Nov 10 15:59:17.723716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 327/698] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:18.167442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:18.168414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:18.175094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.175542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.176320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.176783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.208677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-55721439-8069-42ae-9b75-8e5df67768e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Nov 10 15:59:18.209185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 372/699] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:18.427095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:18.427925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:18.435089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.435614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.436397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.436831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.578927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:18.587552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:18.589019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:18.590215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a43d2f46-0f3e-431a-b5ea-d61ae2c7cbd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168808 Nov 10 15:59:18.590794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 328/700] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:18.735219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:18.736122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:18.744925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.745382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.746188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:18.746624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:18.782762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-819385a0-4ba0-4f46-a43a-24fe09b66fd7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051237 Nov 10 15:59:18.783238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 373/701] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:19.221071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:19.222005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:19.228865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.229327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.230254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.230679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.265431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-212dad71-20d8-4d03-aff1-9c2c5b88ee12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 Nov 10 15:59:19.266052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 329/702] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:19.613700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:19.614487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:19.620652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.621091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.621887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.622342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.773877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:19.784272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:19.786728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:19.787968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5bfd8a38-a10d-4208-8925-1d873cfa2ed2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178011 Nov 10 15:59:19.788542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 374/703] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:19.794775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:19.795686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:19.802781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.803350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.804120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:19.804548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:19.838039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6753ac9d-d351-42de-8b44-2ed7f5ec4c5c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046939 Nov 10 15:59:19.838633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 330/704] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:20.277336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:20.278693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:20.285568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.286025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.286831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.287292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.319895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4278fe92-4f86-41ff-aa89-77dac9975329 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Nov 10 15:59:20.320447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 375/705] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:20.808171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:20.808743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:20.818369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.819075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.820323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.821061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.849014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:20.849959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:20.856861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.857334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.858137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:20.858609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:20.892147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7e3c3d85-75f7-4801-8dda-05b68699ac4d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Nov 10 15:59:20.892724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 376/706] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:20.967836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:20.981933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:20.984270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:20.985601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d6cfa222-830a-43f7-b427-a6e966c2fa94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.181433 Nov 10 15:59:20.986390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 331/707] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:21.334687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:21.335643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:21.342511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:21.342972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:21.343781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:21.344223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:21.375783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8a2c07fd-4053-4019-93fe-959147501c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Nov 10 15:59:21.376383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 377/708] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:21.906198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:21.907162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:21.920698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:21.921182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:21.922038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:21.922491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:21.955753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f473096d-a6b0-443a-910e-0e2c0e8bd1b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054787 Nov 10 15:59:21.956365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 332/709] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:22.005520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:22.006141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:22.013924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.014663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:22.015644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.016084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:22.175565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:22.185121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:22.186990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:22.188149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f92d94f8-2491-4101-a844-f5b67bc052a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.186394 Nov 10 15:59:22.188704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 378/710] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:22.388598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:22.389526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:22.396519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.397678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:22.397678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.398127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:22.438999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56959fe8-270c-42b1-81ec-165caf248dd3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054157 Nov 10 15:59:22.439441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 333/711] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:22.969151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:22.970056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:22.976872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.977351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:22.978206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:22.978668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:23.013426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4c2a8448-56db-44cd-9093-002f942da7e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 Nov 10 15:59:23.014133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 379/712] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:23.212834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:23.213500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:23.220727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:23.221202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:23.222342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:23.223037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:23.366396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:23.378496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:23.380001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:23.381156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b1923747-2bac-44b6-bb5e-b1fc8c2d8d96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.173807 Nov 10 15:59:23.381702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 334/713] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:23.451340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:23.452266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:23.458736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:23.459200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:23.459986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:23.460429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:23.491439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7df4f1cf-0894-4c05-ac37-5ba0292bb3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044224 Nov 10 15:59:23.492029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 380/714] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:24.025244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:24.026226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:24.033193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.033632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.034456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.034919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.071824 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-161bb648-c50a-43ed-96d4-0c89c078f86d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050101 Nov 10 15:59:24.072691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 335/715] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:24.403630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:24.404271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:24.410993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.411447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.412262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.412770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.503354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:24.504272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:24.511101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.511552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.512360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:24.512794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:24.544852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bcc335e7-7091-4e95-8eab-cf5b5b4073a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045250 Nov 10 15:59:24.545422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 336/716] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:24.558865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:24.571387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:24.572839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:24.574048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3a983fc7-22b2-4dbe-abfc-2caf5f9bed9c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176285 Nov 10 15:59:24.574593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 381/717] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:25.083970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:25.084886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:25.091521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.091927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.092707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.093130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.124369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4288d79e-091f-4d2f-9ba8-e44b3607abfb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Nov 10 15:59:25.124932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 337/718] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:25.556937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:25.557860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:25.565565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.566140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.566864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.567285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.593505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:25.595282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:25.599629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9f4101ab-087f-4640-9609-76bb64a1e876 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046554 Nov 10 15:59:25.600218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 382/719] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:25.601466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.601920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.602750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:25.603190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:25.757331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:25.767115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:25.768663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:25.769861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-94eedb17-8574-43b7-89e5-7327244039d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180159 Nov 10 15:59:25.770477 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 338/720] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:26.136995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:26.137910 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:26.144228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.144672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.145469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.145931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.177681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-40b91c8b-0e0a-4cac-9add-d582b728571d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Nov 10 15:59:26.178268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 383/721] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:26.612919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:26.613861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:26.620524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.620904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.621675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.622110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.652202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-54efd1cb-b65b-4757-82c4-4a0f01a1b59c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Nov 10 15:59:26.652733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 339/722] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:26.789137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:26.789900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:26.796844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.797294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.798080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:26.798555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:26.935210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:26.944311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:26.945821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:26.947031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e5972189-81e1-411f-a943-3847d62b171d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.161886 Nov 10 15:59:26.947780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 384/723] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:27.189456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:27.190311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:27.196838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.197437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:27.198409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.198846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:27.231140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c5970de-e5c3-417b-90a1-85ceeec906af tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Nov 10 15:59:27.231702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 340/724] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:27.664077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:27.664987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:27.671809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.672236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:27.673018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.673447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:27.703903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9970755f-54c3-499d-b822-8f9b6808119f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Nov 10 15:59:27.704472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 385/725] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:27.966380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:27.966987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:27.973745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.974188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:27.975041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:27.975468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:28.113833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:28.122494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:28.123971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:28.125170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3b67094e-11fa-4af9-9364-9362e4beab49 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.162778 Nov 10 15:59:28.125725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 341/726] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:28.242774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:28.243722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:28.254688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:28.255485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:28.256898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:28.257686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:28.293940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-adefd0df-952c-408b-9c35-1c8693c593c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055226 Nov 10 15:59:28.294597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 386/727] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:28 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:28.716385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:28.717301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:28.723814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:28.724286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:28.725071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:28.725483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:28.755996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7cf386dc-87e7-463c-8ebc-519bb571389b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Nov 10 15:59:28.756554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 342/728] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:29.143783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:29.144399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:29.151342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.151855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.152681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.153434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.289235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:29.298815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:29.300311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:29.301520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a1164b40-e70c-4cf4-b2f2-e8aa72987d68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.161662 Nov 10 15:59:29.309709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 387/729] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:29 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:29.309922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:29.309922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:29.313942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.314424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.315218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.315637 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.359764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cc977da7-e888-4fad-9246-fdd32610840a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057249 Nov 10 15:59:29.360831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 343/730] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:29.767731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:29.768632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:29.775098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.775761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.776541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:29.777170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:29.814445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-84819a72-ac1a-44ae-92c0-35d07c37c639 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050365 Nov 10 15:59:29.815023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 388/731] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:30.320321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:30.320934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:30.327636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.328011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.328787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.329204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.374890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:30.375808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:30.382201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.382671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.383447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.383871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.418177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a8d8a123-465d-4dc6-baef-ec05573f4216 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 Nov 10 15:59:30.419103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 389/732] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:30.481722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:30.490694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:30.492387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:30.493550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cb69228a-35f1-416a-8ad9-339e75015a03 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176992 Nov 10 15:59:30.494196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 344/733] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:30.826508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:30.827174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:30.833446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.833887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.834680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:30.835107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:30.865699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6cedae31-24d6-4b8b-a436-a42ba93c02e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Nov 10 15:59:30.866311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 390/734] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:31.430642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:31.431634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:31.438283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.438743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.439542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.439970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.470090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7d527bec-0c37-49ce-bd90-4e428984376c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043226 Nov 10 15:59:31.470710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 345/735] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:31 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:31.513138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:31.513928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:31.520936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.521376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.522179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.522625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.670589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:31.679349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:31.680828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:31.682001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2afa2bd6-e1a7-4a1b-bebf-c8f411e7d0c3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.172984 Nov 10 15:59:31.682551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 391/736] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:31.877934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:31.878775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:31.885777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.886384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.887188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:31.887609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:31.926628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8a2e180b-fb8e-46be-9daf-8dea42843aa1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052537 Nov 10 15:59:31.927224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 346/737] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:32.482137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:32.483457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:32.491010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.491462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.492418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.492909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.527129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3cae65d9-5fd3-4a03-858e-d13108a739b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048518 Nov 10 15:59:32.528749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 392/738] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:32.700998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:32.701627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:32.712950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.712950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.712950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.712950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.851132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:32.860741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:32.862238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:32.863408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f06cdfd7-39c7-45dd-b635-6ee62268afba tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.166150 Nov 10 15:59:32.863974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 347/739] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:59:32.939074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:32.940156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:32.946681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.947134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.947964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:32.948401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:32.981149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a9561037-b55e-48d3-95af-5157caefc7f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Nov 10 15:59:32.981895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 393/740] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:33.539518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:33.540405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:33.547063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:33.547564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:33.548398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:33.548932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:33.581920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1d5ed358-f055-4a18-be1f-9b4ebad15c6f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Nov 10 15:59:33.582555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 348/741] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:33.881191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:33.882006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:33.889702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:33.890194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:33.891418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:33.891862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:33.995420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:33.996549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:34.004510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:34.004931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:34.005716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:34.006139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:34.041815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e69e6b08-af71-4e48-87f4-abb3c5cc5691 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052187 Nov 10 15:59:34.042725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 349/742] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:34.051485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:34.062434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:34.063938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:34.065128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9ea78264-e079-44d6-853a-b63609a12649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.187925 Nov 10 15:59:34.065689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 394/743] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:33 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:34.597444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:34.598408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:34.605087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:34.605535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:34.606355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:34.607208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:34.643295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ccfdac3f-360b-4248-b75f-381a3d9b8a7a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049674 Nov 10 15:59:34.643864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 350/744] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:35.054869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:35.055831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:35.063181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.063664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.064458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.064883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.085284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:35.085892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:35.093261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.093818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.094646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.095073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.097681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-382c10cb-e695-423a-a76e-a2bf38c591bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046675 Nov 10 15:59:35.098286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 395/745] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:35.238698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:35.253331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:35.256388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:35.259073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f738634d-f3db-43aa-a366-6e9dccb8e4f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.177298 Nov 10 15:59:35.260108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 351/746] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:35 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:35.655595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:35.655595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:35.662803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.663263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.664057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:35.664487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:35.695821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-414ea60a-2464-4363-929f-dceb7f6a89df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Nov 10 15:59:35.696405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 396/747] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:36.109561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:36.111222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:36.118976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.119419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.120259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.120665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.157113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c47176ab-7f72-4c34-820b-1066f402a279 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051902 Nov 10 15:59:36.157629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 352/748] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:36.289334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:36.290077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:36.297458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.297905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.298754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.299184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.449174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:36.458709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:36.460187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:36.461358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2e83df94-0254-4901-8eff-b48a31c5fae8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176256 Nov 10 15:59:36.461987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 397/749] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:36.710484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:36.711612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:36.719805 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.720238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.721034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:36.721453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:36.753598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d25d44a0-45a8-40b6-b276-ce103f432de1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049011 Nov 10 15:59:36.754194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 353/750] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:36 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:37.170908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:37.171835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:37.178544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.179001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.179784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.180219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.211671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cac35af1-4c11-4694-842a-4afe67222796 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Nov 10 15:59:37.212489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 398/751] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:37.480772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:37.481400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:37.488449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.488895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.489681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.490112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.647096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:37.657629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:37.659167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:37.660349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a0eb0ff8-c49c-4b5d-929e-f8dc6dd99d11 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.183501 Nov 10 15:59:37.660916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 354/752] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:37.767214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:37.768154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:37.775042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.775698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.776575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:37.777125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:37.816776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4aaf8e8c-d35b-4758-8973-81ec5c68b3ff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053650 Nov 10 15:59:37.817351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 399/753] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:38.224878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:38.225750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:38.233642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.234483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.235406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.235889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.269629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87922b30-c295-446a-9136-03e38c4f662c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048606 Nov 10 15:59:38.270223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 355/754] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:38.680354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:38.680957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:38.690414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.690980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.692042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.692723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.828952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:38.829924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:38.836523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.836975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.837765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:38.838215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:38.847485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:38.856417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:38.858052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:38.859625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa3f2728-b232-4e21-bdcf-86521a919457 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.183144 Nov 10 15:59:38.860198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 400/755] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:38.873138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4502cfa8-6be0-4f70-bf1c-f9b1864c5217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Nov 10 15:59:38.873876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 356/756] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:38 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:39.281318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:39.282329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:39.289114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.289663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.290579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.291013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.323829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-775e22d4-fa9f-43ec-b0fb-0f1bd7ee3fd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Nov 10 15:59:39.324412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 401/757] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:39.883760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:39.884748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:39.885025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:39.885953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:39.893538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.893975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.894126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.894629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.894771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.895214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.895422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:39.895844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:39.928127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-097db562-407b-4f6c-97e0-a441394feaea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Nov 10 15:59:39.928729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 402/758] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:40.044725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:40.057236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:40.059293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:40.060458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6ba2b677-200e-4c0e-9c99-f0273b567c0a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180869 Nov 10 15:59:40.061142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 357/759] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:39 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:40.336621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:40.337759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:40.344471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:40.344932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:40.345761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:40.346221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:40.377584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dd25ee78-b6be-4540-b617-77f2977fcd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Nov 10 15:59:40.378192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 403/760] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:40.940464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:40.941362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:40.948255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:40.948692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:40.949462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:40.949882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:40.982374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-425208bf-4d65-4185-9e73-b32e88e08a63 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045855 Nov 10 15:59:40.982907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 358/761] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:41.083651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:41.084266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:41.093718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:41.094481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:41.095294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:41.095759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:41.306368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:41.316652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:41.318214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:41.319410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58581e5a-6008-40bb-a0a8-885b9249c0cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.240614 Nov 10 15:59:41.319985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 404/762] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:41 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:41.389513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:41.390450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:41.397377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:41.397800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:41.398645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:41.399078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:41.430742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ff6c717a-178d-43a4-8fe1-8b4ee475d49f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Nov 10 15:59:41.431416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 359/763] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:41.997207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:41.998284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:42.005739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.006204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.007022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.007464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.038684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-85028f4c-e0af-4986-a71d-aa5b1e710058 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046753 Nov 10 15:59:42.039247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 405/764] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:42.339085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:42.339674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:42.346952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.347393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.348175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.348603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.443590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:42.444534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:42.451836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.452276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.453086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:42.453519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:42.487398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-118742a1-0d9f-4dfa-9f2c-86f7e3874a11 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Nov 10 15:59:42.487975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 406/765] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:42.566415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:42.575826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:42.577314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:42.578557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-472b453c-b779-4625-85cd-981f1e96942c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.243407 Nov 10 15:59:42.579147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 360/766] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:43.051127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:43.052167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:43.058932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.059367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.060192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.060583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.092078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4f240ce7-36f0-47c3-8f6e-3f050d51a0fb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Nov 10 15:59:43.092636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 407/767] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:43.499989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:43.500918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:43.508921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.509359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.510192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.510625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.542883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e095a4c2-0e61-4541-a56f-7ec14dbff627 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Nov 10 15:59:43.543472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 361/768] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:43.598544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:43.599200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:43.605885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.606366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.607192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:43.607613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:43.788599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:43.797971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:43.799884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:43.801079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9e711da0-aa76-44ed-a309-cbd12016edd0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.207239 Nov 10 15:59:43.801836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 408/769] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:44.105288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:44.106271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:44.113234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.113681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.114501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.114941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.150435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9c22b28f-3a9b-4a07-9deb-1d21a8ce9dd5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049423 Nov 10 15:59:44.151351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 362/770] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:44.554631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:44.555655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:44.561949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.562437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.563217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.563643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.598845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c694d3e6-2513-4383-a307-df4c947a3cd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047996 Nov 10 15:59:44.599560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 409/771] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:44.824802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:44.825420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:44.832238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.832678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.833492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:44.833918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:44.985206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:44.994842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:44.996336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:44.997925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-19402399-ceed-461e-82eb-44603831d33d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.177438 Nov 10 15:59:44.998650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 363/772] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:45.172476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:45.172476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:45.174734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:45.175222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:45.176012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:45.176437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:45.208278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d66d7b30-7bd2-464d-a22f-9579dc8f30d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Nov 10 15:59:45.208850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 410/773] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:45.224881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 15:59:45.225136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 15:59:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 15:59:45.610809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:45.611739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:45.618058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:45.618542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:45.619351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:45.619776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:45.652084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d758d4a9-12bd-4547-baf5-79f2bd7605f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Nov 10 15:59:45.653010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 364/774] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:46.018019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:46.018767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:46.025513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.025960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.026784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.027237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.174529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:46.189611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:46.192781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:46.194879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee43901e-d921-4e16-bbff-98b6ac19aa04 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180403 Nov 10 15:59:46.195777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 411/775] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:46 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:46.224273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:46.225165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:46.231847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.232401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.233185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.233611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.269336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-149aa605-a156-464a-bde4-bd5246e5062f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049343 Nov 10 15:59:46.269775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 365/776] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:46 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:46.664663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:46.665516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:46.672552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.673008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.673765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:46.674329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:46.709203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2955a8c9-ba7a-477b-8bb4-2f8b4dee81d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048329 Nov 10 15:59:46.710850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 412/777] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:47.216556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:47.217481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:47.226462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.227394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.227777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.228242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.283971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:47.285592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:47.293237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.293681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.294851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.295525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.333340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-edd6c497-bc56-448f-adc7-8972fb4bfba8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056336 Nov 10 15:59:47.334236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 413/778] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:47 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:47.406682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:47.416317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:47.417825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:47.419137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-981a24ee-e5ea-4a77-843a-5927aa76223d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.208721 Nov 10 15:59:47.419698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 366/779] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:47.723255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:47.724518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:47.734051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.734539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.735388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:47.735868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:47.773061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44c1edd6-c366-4d15-a4ab-85ccabbd582e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055221 Nov 10 15:59:47.773576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 414/780] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:48.345195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:48.346061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:48.352834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.353279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.354062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.354554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.385905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d8ecd4da-3fc1-4889-9a82-b26fb49120dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Nov 10 15:59:48.386520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 367/781] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:48.439183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:48.439794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:48.448200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.448976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.450229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.451067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.614889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:48.624882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:48.626411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:48.627607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-88f01bc2-f1e7-4de2-8a2c-231da6f485d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.192475 Nov 10 15:59:48.628170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 415/782] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:48.785416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:48.786491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:48.793373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.793823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.794679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:48.795130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:48.829792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-da9a07ec-a018-41ed-b068-9a203c7025a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Nov 10 15:59:48.830396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 368/783] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:49.399652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:49.400593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:49.408084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.408562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.409494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.409915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.441860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3e32722b-5e7a-4ca0-a4b0-8c7c40c86a23 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047495 Nov 10 15:59:49.442606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 416/784] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:49.649173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:49.649905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:49.662587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.664025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.664897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.665297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.842478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:49.846119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:49.847503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:49.856875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:49.857821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.858572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.859552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:49.859858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:49.860593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:49.861543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9bb547c-0fce-4d2b-8791-cb705df256e1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.218171 Nov 10 15:59:49.862491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 369/785] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:49.908070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee4fecde-dbf2-4ad9-b8a4-c07efcdec0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068418 Nov 10 15:59:49.908999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 417/786] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:50.453872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:50.454803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:50.461452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.461885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.462704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.463142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.494748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1cd09aa8-5da8-44e7-aa29-7eab3f12a2b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Nov 10 15:59:50.495323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 370/787] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:50 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:50.890835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:50.891379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:50.898937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.899375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.900169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.900652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.921108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:50.922025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:50.929395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.930428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.930795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:50.931220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:50.964488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-232e8be4-1613-4c44-abc4-7de6fdf40ceb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047211 Nov 10 15:59:50.965073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 371/788] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:51.048750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:51.060488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:51.062310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:51.064057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2199edd5-f7b1-4f03-aecc-a199d3059d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178400 Nov 10 15:59:51.064841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 418/789] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:51.508476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:51.509336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:51.515792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:51.516261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:51.517030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:51.517427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:51.557614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-03359863-c281-4c34-a2e9-75fb49b84b06 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053357 Nov 10 15:59:51.558764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 372/790] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:51.975946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:51.977045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:51.985545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:51.986139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:51.987162 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:51.987732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:52.020754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7594eb9d-74ac-4b84-96a5-e3e3a0f79bc7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048663 Nov 10 15:59:52.021298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 419/791] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:52.083857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:52.084718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:52.095467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:52.096235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:52.097638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:52.098524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:52.254431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:52.265905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:52.267407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:52.268564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-12607cb8-c678-475b-b834-3a28ee6390f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.188589 Nov 10 15:59:52.269136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 373/792] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:52 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:52.572884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:52.573730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:52.580030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:52.580480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:52.581267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:52.581702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:52.624128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b9bd7383-701e-4e13-8e4e-55e6b87ef1f4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055367 Nov 10 15:59:52.624739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 420/793] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:53.032556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:53.033426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:53.040107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.040606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.041407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.041833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.074021 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2b864611-cff3-487e-aef8-6d4c99bc08d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Nov 10 15:59:53.074789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 374/794] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:53.299556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:53.300218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:53.306937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.307365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.308149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.308583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.445165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:53.454375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:53.455906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:53.457091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9d2c2b35-1678-4fbf-8415-95a8ed7efd62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.161395 Nov 10 15:59:53.457654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 421/795] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:53.638645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:53.639644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:53.646937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.647653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.648530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:53.648950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:53.681363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cf4618a1-538e-4df8-b3be-92af5b52989a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048554 Nov 10 15:59:53.681915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 375/796] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:54.087216 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:54.088144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:54.094554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.095007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.095850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.096600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.133383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b3d682f4-77af-4211-b345-cc2eeaf81eb9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050058 Nov 10 15:59:54.133964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 422/797] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 15:59:54.477455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:54.477992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:54.485219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.485672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.486462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.486893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.628895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:54.638196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:54.639784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:54.640988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-62125403-d663-49e7-8bb0-afa9975c0b28 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.167997 Nov 10 15:59:54.641584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 376/798] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:54.693500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:54.694518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:54.700998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.701507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.702280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:54.702718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:54.733289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-459c1590-efaf-4f97-8bca-ae5e7e9396b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Nov 10 15:59:54.733759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 423/799] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:54 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:55.145328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:55.146277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:55.153230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.153672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.154505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.154927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.197067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2d067fa6-205b-4451-9194-87c0ad575d8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055108 Nov 10 15:59:55.197691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 377/800] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:55.664084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:55.664873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:55.672504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.678542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.678542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.678542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.745790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:55.746778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:55.753742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.754208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.755024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:55.755446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:55.790091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c9e12a43-20fe-4dc3-8174-bc5568c56348 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048138 Nov 10 15:59:55.791406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 378/801] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:55 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:55.840453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:55.849424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:55.850983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:55.852102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-67e0e0ee-ca79-44b4-b16a-dc2ce20ff781 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.193375 Nov 10 15:59:55.852653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 424/802] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:56.211039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:56.211862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:56.218479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:56.218929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:56.219712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:56.220134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:56.252778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c8ddb8e8-d87b-4075-9baf-26f2eb93d020 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Nov 10 15:59:56.253352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 379/803] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:56.808859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:56.809933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:56.817055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:56.817502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:56.818358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:56.818945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:56.850473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-78ffb1a7-a91a-46d8-876f-9e205683770f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Nov 10 15:59:56.851248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 425/804] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:57.005847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:57.006643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:57.012716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.013149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.013936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.014400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.172488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:57.185729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:57.188374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:57.190132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a366b755-1573-4be0-a702-8785710e3217 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.323342 Nov 10 15:59:57.190968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 380/805] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:56 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:57.381175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:57.382501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:57.389082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.389702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.390658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.391104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.423465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d9828933-95c3-40eb-aed9-fc4a9496d11c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162649 Nov 10 15:59:57.424132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 426/806] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:57.865571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:57.866876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:57.873222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.873657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.874469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:57.874895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:57.908911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2d04e702-1281-48b2-b68b-7f57751d0625 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048178 Nov 10 15:59:57.909643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 381/807] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:58.215438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:58.216014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:58.223920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.224367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.225191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.225697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.369350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:58.378965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:58.380499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:58.381866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-18faab78-6cc3-45a9-a621-741695dbf715 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.170550 Nov 10 15:59:58.382537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 427/808] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:58 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 15:59:58.435500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:58.436408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:58.442548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.442987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.443900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.444353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.478898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-40e3bd18-c7a4-4502-9e96-85cba88a5f9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Nov 10 15:59:58.479768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 382/809] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:58.922361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:58.923300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:58.930342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.930804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.931606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:58.932041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:58.964650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a488b782-49d9-456e-b500-5746d0f7580d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047149 Nov 10 15:59:58.965244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 428/810] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:59.400941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:59.401722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:59.409465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.409904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:59.410700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.411147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:59.492649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:59.493706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:59.500572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.500918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:59.501743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.502191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:59.545806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-40eeb40c-7287-45ff-99aa-26c5e05f56e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056648 Nov 10 15:59:59.546877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 429/811] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 15:59:59.566878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:59.577196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:59.578763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 15:59:59.580003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e5f5c140-319c-42cf-abcf-c80e5e8548da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.183118 Nov 10 15:59:59.580567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 383/812] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 15:59:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 15:59:59.979461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 15:59:59.980777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 15:59:59.989789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.990358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 15:59:59.992609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 15:59:59.992609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:00.027084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7db6aa2d-029f-4ee2-a137-013d6193f711 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052991 Nov 10 16:00:00.027923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 430/813] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 15:59:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:00.558770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:00.559580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:00.572603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:00.573500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:00.573865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:00.574440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:00.602659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:00.603702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:00.607026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bc123548-d0c4-49cf-96a5-1402e4797d7c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052105 Nov 10 16:00:00.607606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 384/814] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:00.612563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:00.613025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:00.613883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:00.614380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:00.761104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:00.770653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:00.772237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:00.773492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-43032bb1-b2c0-485f-8a8b-1f0b5d6442c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.177996 Nov 10 16:00:00.774347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 431/815] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:00 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:01.040419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:01.041428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:01.048055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.048497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.049291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.049721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.081412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-edb8433e-a9c6-4d57-af39-7543a1ef98e5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Nov 10 16:00:01.082007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 385/816] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:01.619956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:01.621007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:01.633725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.634526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.635874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.636621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.669215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6030ff2f-45d0-4263-966e-c6a7fb03dd28 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053905 Nov 10 16:00:01.669870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 432/817] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:01.793225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:01.793835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:01.800618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.801066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.801849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:01.802316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:01.959013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:01.970127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:01.972083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:01.973215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4d004aaf-0d61-4b68-bc04-935011ced55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.183764 Nov 10 16:00:01.973781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 386/818] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:02.093246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:02.094210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:02.101125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:02.101576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:02.102511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:02.102951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:02.135651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-310764b6-4196-44e2-afbd-b0988c6a0cf3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Nov 10 16:00:02.136257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 433/819] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:02.681666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:02.682609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:02.690193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:02.690674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:02.691607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:02.692192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:02.730299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e87db7f6-cf5d-407d-b1af-06d1001bb9b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052481 Nov 10 16:00:02.730895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 387/820] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:02.992730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:02.993358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:02.999938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.000386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.001154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.001585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.143732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:03.147568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:03.149576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:03.154511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:03.155927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:03.157287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.157436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-621d3c28-3cbd-41df-aca0-09bd3a79638e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168298 Nov 10 16:00:03.157735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.157989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 434/821] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:02 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:03.158582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.159010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.195661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-47ad64d8-48ab-4206-8e18-b1def41edf8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051569 Nov 10 16:00:03.196665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 388/822] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:03.547827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:00:03.548048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:00:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:00:03.745646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:03.746797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:03.753981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.754459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.755259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:03.755694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:03.788409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ebb64aea-e140-4f71-be91-6eb352ca10ec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048538 Nov 10 16:00:03.788988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 435/823] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:04.175945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:04.176528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:04.183160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.185353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.185353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.185353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.209319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:04.210300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:04.217870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.218362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.219181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.219620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.263262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c66b730b-d4f4-423e-a57f-f528443c5c7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056999 Nov 10 16:00:04.264357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 436/824] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:04.348280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:04.362388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:04.365280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:04.366847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c30a2c13-dfde-40c3-8945-ca0164f242a6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.194856 Nov 10 16:00:04.367936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 389/825] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:04.800510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:04.801424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:04.808044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.808484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.809271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:04.809737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:04.847120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-134f5f50-b74c-41c2-92af-746b7df72573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049992 Nov 10 16:00:04.847961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 437/826] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:05.280404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:05.281024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:05.287285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.287704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.288511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.288947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.324136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-89112e0e-c4c3-45e6-928b-9e47d02dff3e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048567 Nov 10 16:00:05.324735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 390/827] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:05.387356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:05.388047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:05.394854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.395306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.396100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.396540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.545489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:05.556153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:05.557811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:05.559284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-09c92b90-7139-4d4c-aa29-85e817d33fb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.176046 Nov 10 16:00:05.559874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 438/828] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:05.861820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:05.862667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:05.873503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.875206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.875986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:05.876493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:05.911487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7914664b-cd54-4775-a0fc-1c028a4dc061 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054842 Nov 10 16:00:05.912381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 391/829] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:06.336586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:06.337869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:06.344693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.345146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.345942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.346412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.378717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a1bcc82d-2453-49dc-a989-82530049c146 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Nov 10 16:00:06.379321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 439/830] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:06.582427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:06.583277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:06.591103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.591545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.592327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.592758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.734403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:06.743905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:06.745430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:06.746632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c5b8116f-2ad8-4d1d-87e2-03b26b6446a8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.169796 Nov 10 16:00:06.747202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 392/831] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:06 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:06.924214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:06.925038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:06.931839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.932283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.933089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:06.933539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:06.964632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ea8fd483-a7f4-49a4-b8f3-85ca490298ad tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Nov 10 16:00:06.965215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 440/832] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:07.390566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:07.391475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:07.398086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.398557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:07.399332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.399773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:07.430765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9fbed8d7-c443-4d60-aad5-9e10e7c3772d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Nov 10 16:00:07.431347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 393/833] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:07.765146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:07.765746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:07.772275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.772722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:07.773516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.773950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:07.916667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:07.926101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:07.927616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:07.928810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbb86a86-e171-45a7-ae9a-209eecd90cdd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.167567 Nov 10 16:00:07.929321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 441/834] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:07.977046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:07.977958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:07.984727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.985194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:07.985977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:07.986437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:08.025531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-50cce651-42be-4944-be42-6ca4e663b4aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052084 Nov 10 16:00:08.026279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 394/835] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:08.447398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:08.448705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:08.455915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:08.456472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:08.457298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:08.457526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:08.489363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e59f9358-40f7-4222-a6d4-5eb890b1808f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048785 Nov 10 16:00:08.489926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 442/836] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:08.947453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:08.948002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:08.954767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:08.955213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:08.955993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:08.956426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:09.038461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:09.039560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:09.046028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:09.046506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:09.047444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:09.047836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:09.082547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-438fb155-be9a-4e71-9d57-b9cea5a83a45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Nov 10 16:00:09.083984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 443/837] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:09.101451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:09.111839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:09.113327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:09.114563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2ca70965-02b3-439b-8a1f-fd1431b6e910 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.171046 Nov 10 16:00:09.118365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 395/838] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:08 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:09.501287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:09.502106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:09.509549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:09.509975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:09.510893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:09.511259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:09.543804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f61433ed-e05b-4f60-89b8-e002fedd9fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046521 Nov 10 16:00:09.544346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 444/839] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:10.095046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:10.095979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:10.103607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.104633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.105036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.105734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.133904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:10.134622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:10.142561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.142561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.143853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.144409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.147661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-873e0b73-0a06-42b1-a5ba-8ca3cd0ee3d9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056348 Nov 10 16:00:10.148200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 396/840] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:10.317993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:10.327999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:10.329507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:10.330739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c3b2a04d-c855-429a-b4cf-390a41f3b6f3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.201779 Nov 10 16:00:10.331309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 445/841] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:10.555362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:10.556308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:10.563333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.563782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.564570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:10.564985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:10.596149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-17d902ae-ca82-4d15-ae9e-8dfc3cf197b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Nov 10 16:00:10.596739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 397/842] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:11.161487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:11.162442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:11.169309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.169766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.170614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.171055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.204021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b0596a07-c341-4632-a140-1c35ae4666e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047561 Nov 10 16:00:11.204610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 446/843] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:11.357354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:11.357966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:11.364586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.365044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.365861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.366353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.517573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:11.531155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:11.532857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:11.534107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a15b6ded-a847-4601-9ba2-ce373fa7e62c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.180877 Nov 10 16:00:11.534771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 398/844] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:11.607998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:11.609574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:11.616006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.616614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.617308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:11.617733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:11.651691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d32c7b3e-23df-45dd-ac01-90f4bfe62626 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 Nov 10 16:00:11.652604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 447/845] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:12.216113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:12.216925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:12.223434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.223873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.224641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.225060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.256955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6b7ce65a-4144-414b-a241-290998f83f88 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Nov 10 16:00:12.257548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 399/846] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:12.554546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:12.555157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:12.563365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.563806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.564586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.564996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.662829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:12.663815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:12.670933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.670933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.671954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:12.673113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:12.711189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87849cb6-12b0-485f-86dc-da4882d64f27 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051844 Nov 10 16:00:12.711895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 400/847] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:12.713574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:12.725145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:12.727401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:12.729027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac6055d1-7918-493d-811e-8e9d7b8a8cb6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.178034 Nov 10 16:00:12.729798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 448/848] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:13.269301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:13.270234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:13.277076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.277509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.278375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.278802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.312078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e920e15-542b-42c2-995c-be7da7069c6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046573 Nov 10 16:00:13.313785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 401/849] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:13.722851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:13.723781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:13.730314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.730890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.731684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.732122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.747791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:13.749178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:13.756081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.756515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.757302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:13.757758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:13.765474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d3a0ba20-a5ec-40ca-b530-97607d774551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Nov 10 16:00:13.766065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 449/850] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:13.905298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:13.918699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:13.920198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:13.921445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-94e960b6-1349-4110-8a79-e95335f68a1f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.177519 Nov 10 16:00:13.922006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 402/851] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:14.324697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:14.325630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:14.332499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.332943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:14.333713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.334136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:14.366262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7c21df53-33c3-48cf-900d-ea3b3c223ee6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Nov 10 16:00:14.366851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 450/852] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:14.777570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:14.778618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:14.785929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.786409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:14.788319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.788319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:14.819540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4b552b6f-4660-442a-be6b-256e160eb7f3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Nov 10 16:00:14.820110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 403/853] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:14.939698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:14.940413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:14.947170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.947608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:14.948397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:14.949038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:15.088816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:15.098002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:15.099551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:15.100759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-765764d4-d49f-4f32-b70f-ff631595e254 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.164843 Nov 10 16:00:15.101315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 451/854] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:15.380497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:15.381349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:15.388873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:15.389326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:15.390114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:15.390585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:15.427223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f1924c83-791f-42e4-a71d-349d6c070189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051090 Nov 10 16:00:15.427778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 404/855] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:15.831500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:15.832422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:15.838691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:15.839133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:15.839934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:15.840425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:15.872334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d2607038-a372-45c6-b8c8-87e2b789e601 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Nov 10 16:00:15.872912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 452/856] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:16.119862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:16.120463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:16.127920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.128360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.129136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.129546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.285457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:16.295607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:16.297162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:16.298517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-90bc1226-fca6-4951-a7ab-180c462cd90d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.182487 Nov 10 16:00:16.299123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 405/857] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:16.440994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:16.442250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:16.451852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.452431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.453628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.453936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.486501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5c443cd-c3b5-4a43-ad87-d1267866e799 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050738 Nov 10 16:00:16.487233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 453/858] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:16.884351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:16.885329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:16.891935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.892381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.893158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:16.893584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:16.927349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ff30fb63-9325-46a3-9e5b-826ec6f878ae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 Nov 10 16:00:16.927936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 406/859] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:17.321475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:17.322176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:17.329647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.330093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.330900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.331332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.472559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:17.481456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:17.483052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:17.484222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c4d2f753-3dd2-4cd3-a11a-0546810eaa87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.168231 Nov 10 16:00:17.484822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 454/860] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:17.498567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:17.499390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:17.505936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.506415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.507202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.507626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.540531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c503f925-96f9-40a8-a150-7fbf87c0068f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Nov 10 16:00:17.540531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 407/861] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:17.943408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:17.944753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:17.953809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.954302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.955331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:17.955771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:17.996065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8cf0c5d8-9c89-4a2a-9316-274b77543e25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057861 Nov 10 16:00:17.996630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 455/862] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:18.504033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:18.504606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:18.517321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:18.517768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:18.518630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:18.519045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:18.554997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:18.556050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:18.563495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:18.564085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:18.564891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:18.565332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:18.600494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32107eea-738f-49a8-a97c-bd7b3fc49c2e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051115 Nov 10 16:00:18.601395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 456/863] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:18.673296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:18.684739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:18.686366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:18.687501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2a2a8c63-2bd3-4bbb-a105-e27b4a7270cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.187704 Nov 10 16:00:18.688092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 408/864] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:19.007736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:19.008695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:19.015342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.015836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.016621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.017059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.049054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c5645023-d455-461d-9278-e05413b57094 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Nov 10 16:00:19.049613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 457/865] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:19.615682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:19.616863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:19.625444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.625892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.626723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.627146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.663092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b66e9b57-2dec-43eb-adc0-6cef0d5b90bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053277 Nov 10 16:00:19.663642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 409/866] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:19.709903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:19.710618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:19.717490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.717936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.718869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:19.719498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:19.873853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:19.882981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:19.884514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:19.885688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-86082af8-b4a5-4579-b484-74018d9e4752 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1751 microversion: 2.20 time: 0.179928 Nov 10 16:00:19.886260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 458/867] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:20.061159 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:20.062064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:20.068113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.068560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:20.069346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.069779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:20.100744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb6aad99-abb5-4350-833c-f1cb6a0df86c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Nov 10 16:00:20.101343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 410/868] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:20.675713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:20.676582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:20.682953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.683409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:20.684198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.684631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:20.715520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b0dae6f3-b767-4e0d-9497-837684131266 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Nov 10 16:00:20.716388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 459/869] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:20.909394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:20.910029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:20.916678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.917124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:20.918052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:20.918539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:21.073200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:21.083788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:21.086710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:21.086710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7406c97f-8860-4a19-8e4e-f8343b43e825 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180613 Nov 10 16:00:21.086710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 411/870] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:21.112496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:21.113433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:21.119692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:21.120138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:21.120920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:21.121351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:21.152117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9e87a066-b74a-4c70-8c14-0292bb1e8407 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Nov 10 16:00:21.152723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 460/871] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:21.731937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:21.733075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:21.740225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:21.740674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:21.741462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:21.741871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:21.772692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a02f817c-a81f-421f-9c23-ced54826a9b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Nov 10 16:00:21.773273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 412/872] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:22.104707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:22.105684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:22.113717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.114185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.115013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.115441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.163972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:22.165083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:22.174875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.175315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.176144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.176565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.212278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b224554f-728a-40ef-a4c1-1689c5f9a174 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052222 Nov 10 16:00:22.215158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 413/873] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:22.257224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:22.266458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:22.267952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:22.269154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-22bf65b6-d8c8-4e8f-88b1-de33d2e8daaf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.168338 Nov 10 16:00:22.269710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 461/874] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:22.786292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:22.787210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:22.795587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.796231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.797534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:22.798214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:22.833288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-72ad967b-9665-45b9-a1d1-e224d29790a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051857 Nov 10 16:00:22.833847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 414/875] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:23.223578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:23.224512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:23.231337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.231905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.232750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.233175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.264762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c99c2107-6ca0-4ee1-bcda-658e565932c4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Nov 10 16:00:23.265342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 462/876] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:23.287217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:23.287797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:23.294362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.294812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.295575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.295999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.441605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:23.450764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:23.452507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:23.453678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f318f531-6b61-43a0-b483-a5a1d38b58ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.170203 Nov 10 16:00:23.454642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 415/877] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:23.844873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:23.845898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:23.852523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.852864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.853651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:23.854089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:23.884590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4da2b81a-a466-4782-8d7c-95a4b46f82ac tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Nov 10 16:00:23.885159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 463/878] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:24.277451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:24.278404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:24.285340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.285843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.286611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.287047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.318460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-356ebdb1-e71d-4a41-8471-6c92766d79d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Nov 10 16:00:24.319108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 416/879] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:24.473300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:24.473869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:24.480492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.480940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.481704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.482145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.616816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:24.625773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:24.627334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:24.628488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-56f0dec1-1bdc-4e83-8a1b-569a2e3929c9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.159298 Nov 10 16:00:24.629050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 464/880] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:24.897013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:24.897827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:24.904604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.905048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.905822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:24.906268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:24.935943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-db95b763-0c62-4ff2-a61f-4ce9cdbe8fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042888 Nov 10 16:00:24.936532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 417/881] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:25.332148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:25.333159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:25.340041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.340504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.341335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.341758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.373473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4ee7af49-64f7-42ff-b5eb-8e87359a759c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046115 Nov 10 16:00:25.374039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 465/882] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:25.648376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:25.649142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:25.656132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.656571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.657469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.657875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.796670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:25.805303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:25.806832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:25.808282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bf0b8534-9880-47f6-927b-e1b974b682bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.163586 Nov 10 16:00:25.808912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 418/883] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:25.948084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:25.949027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:25.956103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.956579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.957354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:25.957791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:25.989014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d9c2f7bf-b55a-4535-8747-5d846ee35a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Nov 10 16:00:25.989613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 466/884] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:26.387940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:26.388850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:26.395649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:26.396102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:26.396863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:26.397303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:26.427857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-020ca023-6186-4623-9580-41201a730edb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Nov 10 16:00:26.428423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 419/885] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:26.827787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:26.828314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:26.835060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:26.835648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:26.836294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:26.836730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:26.972489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:26.981554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:26.983070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:26.984255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1595a1bc-7433-43ce-9619-696883e3b652 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.160434 Nov 10 16:00:26.984845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 467/886] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:27.000174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:27.001177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:27.007984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:27.008413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:27.009226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:27.009626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:27.040316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9765bf24-3487-468f-b4c0-e304d0fae9ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Nov 10 16:00:27.040918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 420/887] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:27.440022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:27.440982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:27.447954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:27.448411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:27.449207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:27.449638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:27.486869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d8670e51-8ba8-4488-aca4-f7c1969f0dfc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050811 Nov 10 16:00:27.487489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 468/888] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:28.002523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:28.003166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:28.009895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.010387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.011189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.011639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.052690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:28.053613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:28.060162 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.060608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.061400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.061835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.094400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38084b49-02f9-43e4-a19c-4d70d79a6b1b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Nov 10 16:00:28.095413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 469/889] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:28.153335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:28.161912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:28.163423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:28.164592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c7276b7c-0719-493c-9773-147de5ee924e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166195 Nov 10 16:00:28.165140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 421/890] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:28.499404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:28.500330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:28.506811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.507258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.508045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:28.508476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:28.542111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73f01078-f94e-44af-8c88-d8d2ed3a21b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046577 Nov 10 16:00:28.542726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 470/891] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:28 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:29.106763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:29.107671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:29.114807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.115248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.116043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.116466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.148062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb373ffe-dbf6-48fe-a04a-72f95b7cc2ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Nov 10 16:00:29.148542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 422/892] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:29.182830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:29.183403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:29.190078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.190558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.191370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.191812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.332822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:29.341896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:29.343437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:29.344644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-709b0af7-0a69-4ceb-918c-2719f2b31418 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165554 Nov 10 16:00:29.345401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 471/893] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:29 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:29.556173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:29.557407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:29.563959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.564391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.565165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:29.565584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:29.596329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8daa1ac9-ad52-4d35-91f8-0db8322a7366 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Nov 10 16:00:29.596995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 423/894] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:30.160387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:30.161397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:30.169976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.170743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.171987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.172754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.204477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d917c8e0-5b85-4833-a635-70b8d0b93f94 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047989 Nov 10 16:00:30.205193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 472/895] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:30.363514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:30.364256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:30.370883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.371312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.372076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.372495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.517154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:30.525808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:30.527713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:30.528881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a180a0ef-d53d-4a89-b42d-06f043afd623 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169190 Nov 10 16:00:30.529446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 424/896] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:30.609543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:30.610490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:30.617593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.618045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.618869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:30.619330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:30.651089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-94acaf34-1e7c-49bc-88d8-f23ddeb58f0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Nov 10 16:00:30.651979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 473/897] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:31.217004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:31.218077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:31.224720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.225228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.226336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.226666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.261140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d3f679f5-841d-4694-abfa-77cb7319f71b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Nov 10 16:00:31.261846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 425/898] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:31.551105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:31.551903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:31.558357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.558811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.559661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.560093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.664162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:31.665079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:31.671408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.671844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.672639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:31.673063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:31.703998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87b15397-12bd-4712-a5e5-1421e12e16ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Nov 10 16:00:31.704598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 426/899] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:31 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:31.705847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:31.715283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:31.716793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:31.717973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c8cc9e9c-ca56-4b77-ae3f-a1f82460e010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.172593 Nov 10 16:00:31.718559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 474/900] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:32.274025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:32.274995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:32.281829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.282328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.283106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.283540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.317031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-25f030d4-6fcb-44e4-8375-9ea866eabf3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Nov 10 16:00:32.317680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 427/901] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:32.716871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:32.717787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:32.724602 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.725044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.725825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.726285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.736394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:32.737117 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:32.746079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.746657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.747453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:32.747885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:32.761128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8d6d75d7-0022-407d-865a-9a6a5abd2745 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Nov 10 16:00:32.761725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 475/902] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:32.894234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:32.907373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:32.909624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:32.911605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4c5d55bc-5965-402e-bded-5f77f978bc30 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178621 Nov 10 16:00:32.912356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 428/903] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:00:33.329695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:33.330732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:33.337417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.337869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:33.338690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.339127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:33.371414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a3356049-27cd-4a44-ab0e-fe5e6ffd60a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Nov 10 16:00:33.372000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 476/904] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:33.773682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:33.774597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:33.781538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.781984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:33.782826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.783242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:33.815703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-017d715b-0410-4b09-9f88-cfe56c7e51b7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Nov 10 16:00:33.816301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 429/905] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:33.937911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:33.938460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:33.946080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.946562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:33.947342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:33.947775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:34.087653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:34.097459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:34.099004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:34.100693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e4d3ce2a-cabf-47e3-bd61-788dc6e45746 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.168664 Nov 10 16:00:34.101289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 477/906] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:33 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:34.383667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:34.384600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:34.391350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:34.391815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:34.392602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:34.393032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:34.428331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aaa7d9bc-0458-4fbb-80f5-521b7764dc4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049196 Nov 10 16:00:34.428911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 430/907] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:34.829629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:34.830599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:34.837662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:34.838117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:34.838972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:34.839407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:34.873646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e9d16004-2831-4da7-996a-27b578af801c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047767 Nov 10 16:00:34.874226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 478/908] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:35.126369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:35.127139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:35.135039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.135488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.136281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.136716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.285878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:35.296983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:35.298504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:35.299714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b2d14543-3eb1-4dd3-b8ee-7d6ed1d5961d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178492 Nov 10 16:00:35.300287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 431/909] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:35 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:35.440210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:35.441052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:35.447731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.448182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.448976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.449404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.480939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-439e8b17-dc6e-47d7-85c3-4c5f657db498 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Nov 10 16:00:35.481522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 479/910] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:35.885807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:35.886792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:35.893387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.893923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.895010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:35.895508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:35.930502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-771cbb37-db52-49a4-acde-6f1057823fa0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Nov 10 16:00:35.931087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 432/911] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:36.320137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:36.321030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:36.327480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.327935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.328720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.329154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.482616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:36.492530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:36.492960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:36.494015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:36.494248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:36.495382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e0b47ff8-08f3-4d0b-b5fa-f764815c88a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180823 Nov 10 16:00:36.496189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 480/912] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:36.502066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.502526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.503524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.504113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.536203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1091084b-927f-4fd8-b4e8-ea980181ceed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047166 Nov 10 16:00:36.536778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 433/913] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:36.942935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:36.943885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:36.951623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.952095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.952897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:36.953297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:36.985315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d82f4015-3e4d-4af9-b5ee-626b072d58bc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Nov 10 16:00:36.986011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 481/914] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:36 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:37.521106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:37.522011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:37.532957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:37.533722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:37.535153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:37.535851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:37.551689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:37.552772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:37.561176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:37.561647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:37.562474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:37.562962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:37.599814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-793df389-998c-4be3-b86c-96f0ee9c7872 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053370 Nov 10 16:00:37.600819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 482/915] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:37.680312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:37.689460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:37.690980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:37.692133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-60774ae4-bf57-45cf-af45-8deb903fe00f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177864 Nov 10 16:00:37.692710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 434/916] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:37.997222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:37.998290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:38.004800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.005266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.006032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.006499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.043800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f77f19f-df6f-416d-b45f-944f55ed3610 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050278 Nov 10 16:00:38.044398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 483/917] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:38.612084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:38.612856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:38.619985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.620426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.621209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.621620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.653764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9d54e462-098a-4e8a-bb1f-5373e55e2cf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Nov 10 16:00:38.654356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 435/918] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:38.716276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:38.716904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:38.726525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.727004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.727882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:38.728316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:38.877033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:38.887608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:38.889101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:38.890386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c1840fa7-9400-42e3-8802-56870f83eeea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180038 Nov 10 16:00:38.890864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 484/919] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:39.060018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:39.060957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:39.067599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.068042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:39.068837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.069262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:39.100865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-932b7f1a-6114-4b5e-93aa-221a85bc38aa tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Nov 10 16:00:39.101430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 436/920] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:39.671365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:39.672972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:39.682218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.682712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:39.683621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.684155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:39.716598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f4a8f31-36ec-4c61-be45-9ca29cf380bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052466 Nov 10 16:00:39.717312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 485/921] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:39.911333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:39.912172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:39.919103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.919551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:39.920335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:39.920784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:40.074016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:40.083034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:40.084593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:40.085809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-17eb24b0-2e57-428d-a33b-026e66db98c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178601 Nov 10 16:00:40.086395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 437/922] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:39 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:40.113898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:40.114875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:40.122820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:40.123283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:40.124084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:40.124498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:40.157961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bf748070-70d7-444e-ba7a-c1a318682217 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047933 Nov 10 16:00:40.158582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 486/923] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:40.730229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:40.731291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:40.741150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:40.741931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:40.743422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:40.744210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:40.777829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b4445054-dfec-4da7-950f-294023435a7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052880 Nov 10 16:00:40.778454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 438/924] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:41.106588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:41.107202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:41.113462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.113905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.114798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.115185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.170302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:41.171396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:41.178486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.178929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.179724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.180198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.216032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c678f3f2-5b85-40b4-bae0-a45aa0a38e8a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049096 Nov 10 16:00:41.220930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 439/925] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:00:41.283450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:41.295077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:41.297388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:41.298753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a5289f39-ad33-47e4-8844-949cf69a3010 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.196718 Nov 10 16:00:41.299598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 487/926] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:41 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:41.789936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:41.791232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:41.797812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.798277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.799074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:41.799496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:41.831101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e41da4e-e4a4-4a3b-a46f-ad98ed5139a0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Nov 10 16:00:41.831868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 440/927] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:42.227028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:42.227941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:42.237153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.237671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.238776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.239301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.274655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f2bbd8ca-09cf-43eb-81cb-a3d383e45a4c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051339 Nov 10 16:00:42.275340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 488/928] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:42 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:42.317779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:42.318476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:42.326698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.330615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.330615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.330615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.692277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:42.702599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:42.704073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:42.705227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f142679-0e12-48db-962c-43788d2eeb23 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.391466 Nov 10 16:00:42.705780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 441/929] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:42.843327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:42.844233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:42.851049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.851494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.852260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:42.852719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:42.885354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-359a8e98-4a31-47fe-9396-fa7f62a92eb6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Nov 10 16:00:42.885938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 489/930] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:43.287283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:43.288206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:43.295207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.295667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.296435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.296875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.335512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-37d35c78-87b8-44dc-949e-9bfc0a748226 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051807 Nov 10 16:00:43.336231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 442/931] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:43.725500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:43.726279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:43.733926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.734408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.735200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.735639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.883094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:43.893591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:43.895192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:43.896379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-10285763-346a-40ae-97f6-06577cdcdc13 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.175533 Nov 10 16:00:43.897249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 490/932] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:43.900658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:43.901909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:43.908845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.909439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.910365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:43.910787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:43.945742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9f1ccc89-e565-443e-a6c4-dcfcb9aff4fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051159 Nov 10 16:00:43.946435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 443/933] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:44.348541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:44.349693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:44.357048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.357487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:44.358291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.358735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:44.390404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6be20fdf-256d-4098-a819-14d9b3569378 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045977 Nov 10 16:00:44.390989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 491/934] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:44.915675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:44.916495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:44.923407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.923849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:44.924645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.925179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:44.957258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:44.958190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:44.965975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.966477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:44.967395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:44.967884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:45.002859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d8f03bc3-ebf4-4090-9172-8a539864a72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Nov 10 16:00:45.003427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 492/935] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:45.078138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:45.087313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:45.088960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:45.090570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-841d2650-53e7-4320-a4fd-7314e43d1a8d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178836 Nov 10 16:00:45.091458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 444/936] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:45.402341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:45.403270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:45.412062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:45.412834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:45.414269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:45.415023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:45.448114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32ee6f7b-1b45-44c5-a661-d1649d4f548a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049805 Nov 10 16:00:45.448731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 493/937] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:46.014979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:46.015918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:46.022777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.023224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.024010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.024447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.056419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-10324cd9-02fa-4349-a3e5-fb9f5a007978 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Nov 10 16:00:46.057094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 445/938] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:46.110506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:46.111115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:46.119316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.119316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.121288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.121288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.288511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:46.297853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:46.299421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:46.300614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c6acbec6-a957-4382-92e0-77901982a37f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.194494 Nov 10 16:00:46.301193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 494/939] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:46 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:46.459965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:46.460920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:46.467448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.467877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.468687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:46.469108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:46.502568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a04fdd98-9e04-4232-a20b-217d9792ffcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046089 Nov 10 16:00:46.503318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 446/940] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:46 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:47.070790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:47.071872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:47.082918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.083725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.085159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.085851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.124577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bd45d7f5-cc4e-47ea-bcda-f341f12b1ded tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059375 Nov 10 16:00:47.125427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 495/941] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:47.323890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:47.325014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:47.336067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.336864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.338495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.339260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.516330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:47.517324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:47.523930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.524379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.525264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:47.525856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:47.536023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:47.545949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:47.547564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:47.548762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-738b89cb-5e49-40ed-b15b-855080fb3e44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.232430 Nov 10 16:00:47.558225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 447/942] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:47.561812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38caded7-18fc-428d-ac03-ebbf9b3291ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049768 Nov 10 16:00:47.562464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 496/943] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:47 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:48.138932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:48.139916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:48.148903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.149303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.150090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.150657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.182714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-101a60a8-ce66-4c15-9604-b7e490d2dbcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Nov 10 16:00:48.183326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 448/944] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:48.569305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:48.571009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:48.579516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.580287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.581365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.581898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.663720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:48.665389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:48.672426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.672906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.673694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:48.674115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:48.717918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0a7cedeb-2736-4940-b9a5-9e3771004cb7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146502 Nov 10 16:00:48.718568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 449/945] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:48.749011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:48.758466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:48.759944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:48.761707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d941395b-b8d5-4eea-919b-26ee9df129cc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.198009 Nov 10 16:00:48.762650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 497/946] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:49.194691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:49.195599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:49.202471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.202948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.203723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.204152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.236049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f0937433-0a9f-47f2-9635-bdcbd9f11f57 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Nov 10 16:00:49.236634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 450/947] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:49.733298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:49.733298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:49.739291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.739893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.740880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.741581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.780258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a532c1d7-3d10-404b-a8fa-c11aafba4828 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054575 Nov 10 16:00:49.781085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 498/948] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:49.782833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:49.783487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:49.790296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.790733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.791627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:49.792049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:49.943727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:49.952908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:49.954478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:49.955698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3e321962-7e49-41f3-a045-aa7f4558b7eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177563 Nov 10 16:00:49.956284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 451/949] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:50.248918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:50.249866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:50.256584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.257038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:50.257832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.258299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:50.293989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-99731936-9486-4add-85d3-f8f68532c874 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049285 Nov 10 16:00:50.294636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 499/950] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:50.793832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:50.794794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:50.801716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.802178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:50.803179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.803603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:50.834754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e042dc0b-a1c0-49f1-aae8-41e555483041 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Nov 10 16:00:50.835224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 452/951] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:50 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:50.974735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:50.975339 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:50.982572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.983015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:50.983869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:50.984563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:51.185894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:51.199721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:51.202318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:51.203823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38655b8e-3ded-46e7-8cf8-21467f1efb21 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.233045 Nov 10 16:00:51.204409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 500/952] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:51.307579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:51.308546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:51.317249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:51.317707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:51.318929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:51.319372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:51.374808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a581f449-10e5-4f9d-aa37-9900edfa7a20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072838 Nov 10 16:00:51.375523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 453/953] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:51.850984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:51.850984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:51.855439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:51.856072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:51.857077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:51.857629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:51.889667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4778a141-37d8-4e7d-b0ee-aa847361fb9f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Nov 10 16:00:51.890148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 501/954] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:52.233050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:52.233634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:52.240231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.240694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.241504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.241961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.387035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:52.387999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:52.392399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:52.394949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.395596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.396411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.396853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.405047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:52.406589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:52.408023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a057b627-7071-41da-a174-605c9ae728ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.179520 Nov 10 16:00:52.408684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 454/955] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:52 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:52.432118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-12b4c2a1-278d-4b00-a5db-88ee3d31d251 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049020 Nov 10 16:00:52.432762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 502/956] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:52.903258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:52.904612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:52.911316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.911764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.912744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:52.913133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:52.952022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-63a104d8-ea66-4672-8c34-2a2784efece0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054082 Nov 10 16:00:52.952403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 455/957] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:53.429080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:53.430605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:53.438117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.438615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:53.439422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.439828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:53.445351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:53.446473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:53.453631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.454079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:53.454933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.455366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:53.489246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56114f6d-e1de-49f6-9c28-984732f6a5cb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Nov 10 16:00:53.490222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 456/958] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:53.591103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:53.600941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:53.602567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:53.603758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7be7f0a5-349d-4e4b-b4f6-4fbe4d247397 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178509 Nov 10 16:00:53.604352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 503/959] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:53.963437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:53.964581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:53.971445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.972043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:53.972936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:53.973084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:54.005142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d7dfdf6a-97ec-4536-8304-04bbae88f50d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Nov 10 16:00:54.005713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 457/960] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:54.501510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:54.502387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:54.509166 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:54.509636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:54.510603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:54.511298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:54.546666 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f85416d5-1632-4180-a609-45a332bcb93b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049097 Nov 10 16:00:54.547290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 504/961] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:54.624667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:54.625343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:54.632402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:54.632843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:54.633651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:54.634073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:54.787814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:54.799450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:54.800727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:54.801964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-25698a64-4df6-4c7a-864b-8be11ab5f166 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181309 Nov 10 16:00:54.802893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 458/962] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:55.017362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:55.019538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:55.029408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.029970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:55.030979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.031481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:55.072779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-309cb3c7-1581-4e4e-a7e0-c2c2e6f10b2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058936 Nov 10 16:00:55.073805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 505/963] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:55 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:55.559041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:55.559933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:55.567072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.568967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:55.568967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.569169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:55.607285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-73c44dfd-924f-4cef-9c72-8ede98ef986e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052382 Nov 10 16:00:55.607896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 459/964] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:55.822055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:55.822834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:55.829761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.830234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:55.831029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:55.831461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:56.009465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:56.019369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:56.020882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:56.022138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3d95ef17-9f51-4d21-aa3a-262ce3e64b95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.203987 Nov 10 16:00:56.022734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 506/965] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:56.090907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:56.093852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:56.103196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:56.103961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:56.105210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:56.105645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:56.140668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-decf78da-05bd-4c2b-b442-a8b854bf9da7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056817 Nov 10 16:00:56.141384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 460/966] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:56.620126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:56.621063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:56.628096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:56.628543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:56.629358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:56.629794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:56.665421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-56e73448-3c5e-43dc-b282-dd5ba2725baf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049637 Nov 10 16:00:56.666046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 507/967] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:57.041903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:57.043012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:57.051103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.051619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.052427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.052891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.155070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:57.158210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:57.169957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.170519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.171597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.172105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.212510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-03e6341c-1d9a-4076-a2d3-da93b243a4ea tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062109 Nov 10 16:00:57.213527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 508/968] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:57.254198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:57.272733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:57.274760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:57.277382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6b699725-032e-4b01-98bc-548c6e912b82 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.239526 Nov 10 16:00:57.278443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 461/969] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:57.677881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:57.678871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:57.686119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.686768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.687701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:57.688211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:57.727286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7b149ada-abe7-4dc2-ab04-fc94ad38c070 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053173 Nov 10 16:00:57.728248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 509/970] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:58.224815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:58.225725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:58.233663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.234132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.234942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.235370 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.271632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96ad24ab-ca04-46d9-a330-2f1d6ffa8a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050573 Nov 10 16:00:58.272311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 462/971] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:58.296865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:58.297672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:58.305191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.305656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.306667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.307138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.475782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:58.485228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:58.486884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:58.488090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-42c2e23d-0f16-42a8-a2d9-1194863f7263 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.195451 Nov 10 16:00:58.488653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 510/972] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:58 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:58.743502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:58.745926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:58.753058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.753498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.754228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:58.760109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:58.790308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b0c36be6-a209-4063-8b58-a652fa437440 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052363 Nov 10 16:00:58.790892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 463/973] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:59.287748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:59.288868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:59.299475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.300275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.301677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.302477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.335830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ce61f7b4-dfb3-4c4f-b3d6-1b68fb163fbb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052023 Nov 10 16:00:59.336331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 511/974] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:00:59.507843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:59.508725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:59.516640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.517228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.519032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.519854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.679545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:59.688896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:59.690941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:00:59.692222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb47127b-a198-4714-8af2-978801363519 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.188839 Nov 10 16:00:59.692800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 464/975] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:00:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:00:59.804300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:00:59.805498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:00:59.813531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.814315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.815628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:00:59.816348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:00:59.850289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0b097286-bb2e-4e54-b395-adb6edcf8129 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050950 Nov 10 16:00:59.850880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 512/976] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:00:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:00.348160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:00.349405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:00.355671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.356120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.356914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.357341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.399136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6cc4ec19-6fbf-43af-9fa5-defa20d84972 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054578 Nov 10 16:01:00.399670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 465/977] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:00.711826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:00.712567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:00.719331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.719775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.720573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.721002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.864000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:00.864909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:00.871868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.872319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.873107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:00.873942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:00.882571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:00.892138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:00.893653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:00.895261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cecda6f0-925e-4436-965e-fa28ccd74d5f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.187292 Nov 10 16:01:00.895650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 513/978] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:00 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:00.908243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-30587c38-1f6a-4886-99b5-1933a63459df tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Nov 10 16:01:00.908840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 466/979] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:01.411741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:01.412701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:01.419856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.420423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.421868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.422389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.459736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ab43588b-b9f1-45ee-9432-4c1df8e5d7f1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051743 Nov 10 16:01:01.460253 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 514/980] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:01.917877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:01.918965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:01.921142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:01.922049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:01.928497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.928952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.929603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.929745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.930181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.930372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.931691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:01.932491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:01.962955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df5c9277-b4b5-4d1e-a519-7aaac8450664 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Nov 10 16:01:01.963540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 515/981] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:02.072760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:02.081862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:02.083371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:02.084532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3dd73bc9-7dd1-4374-8bb1-7391483c9dd3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173598 Nov 10 16:01:02.085126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 467/982] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:02.472220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:02.473163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:02.479381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:02.479848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:02.480689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:02.481067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:02.524058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9a3e8e6b-3b9a-42b0-9077-16d23cd06c8f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055882 Nov 10 16:01:02.524620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 516/983] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:02.975628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:02.976643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:02.983967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:02.984392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:02.985183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:02.985610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:03.016178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ea7430c3-4fbf-4b2c-b360-ee5eecdbef3a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Nov 10 16:01:03.016738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 468/984] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:03.103117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:03.103744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:03.110604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:03.111056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:03.111841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:03.112271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:03.258961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:03.267871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:03.269342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:03.270569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-43eec81e-d5c0-41af-8592-334bfd5fd507 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171238 Nov 10 16:01:03.271142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 517/985] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:03 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:03.536981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:03.537819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:03.544438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:03.544886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:03.545764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:03.546212 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:03.576938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8d377011-3cee-4f22-a628-e5014deb9f3a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Nov 10 16:01:03.577509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 469/986] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:04.028229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:04.029308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:04.036099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.036554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.037376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.037807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.071093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bd3dd20c-6260-4f57-a8e9-42072ce2813a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046958 Nov 10 16:01:04.071669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 518/987] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:04.290842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:04.291480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:04.298488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.298930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.299705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.300115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.442993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:04.451744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:04.453237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:04.454441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7cb5407f-a120-42f9-b9f2-37d44862e0a0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167382 Nov 10 16:01:04.455001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 470/988] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:04.588756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:04.590417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:04.597384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.597829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.598716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:04.599143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:04.630534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-55e9bc27-c658-4a24-bc70-9d8912751b0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Nov 10 16:01:04.631115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 519/989] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:05.083138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:05.084055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:05.090750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.091194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.092064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.092522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.125553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-854edf62-ca22-4324-9f67-12f5b2eca94a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Nov 10 16:01:05.126193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 471/990] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:05.473721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:05.474359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:05.480778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.481225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.482005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.482479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.642835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:05.644935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:05.646268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:05.650309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.651303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.652168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:05.652785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:05.655479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:05.656981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:05.658207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-01e3cd9e-4455-4bc1-9857-669c5f19ff25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.188364 Nov 10 16:01:05.658742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 520/991] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:05.683831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fb709113-e829-490e-aea8-935fc8027305 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Nov 10 16:01:05.684400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 472/992] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:06.137545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:06.138465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:06.145549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.146008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.146906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.147348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.179753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a93d76ae-ed98-4377-9924-4d041669bda6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Nov 10 16:01:06.180345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 521/993] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:06.676901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:06.677585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:06.684939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.685377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.686367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.686792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.695789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:06.696734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:06.703242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.703691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.704506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:06.704948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:06.740884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d0f08baa-b499-4d5f-8b6a-b2c4a1d9ec9b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049206 Nov 10 16:01:06.741481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 522/994] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:06.840058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:06.849854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:06.851396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:06.852569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3956ef99-1199-4a77-a5ce-f5efaa805dd6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180110 Nov 10 16:01:06.853109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 473/995] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:06 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:07.192406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:07.193333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:07.200164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.200611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:07.201609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.202056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:07.235255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7cf41c09-c0e9-4b51-9eeb-6a07fbd23871 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046594 Nov 10 16:01:07.235839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 523/996] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:07.753129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:07.753947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:07.760621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.761067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:07.761855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.762290 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:07.791861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bbe950c9-d12f-4877-85a2-e13302dfd652 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Nov 10 16:01:07.792426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 474/997] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:07.871549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:07.872114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:07.879275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.879730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:07.880518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:07.880953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:08.023387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:08.034975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:08.036579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:08.037692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-46db1d75-60e1-4161-922f-3f2ce4a2f2c4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169947 Nov 10 16:01:08.041026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 524/998] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:08.248402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:08.249050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:08.255793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:08.256236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:08.257059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:08.257484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:08.289335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b16f5430-83c3-4b04-852d-be5791a586e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Nov 10 16:01:08.289819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 475/999] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:08.803297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:08.804128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:08.810331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:08.810778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:08.811590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:08.812003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:08.842869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53338079-67e5-4952-9c5c-7a4c3d4da477 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Nov 10 16:01:08.843460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 525/1000] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:09.057538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:09.058268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:09.065539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.065981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.066821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.067245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.212788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:09.222025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:09.223547 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:09.224714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-690d62d9-604f-4eee-95ca-da6f348abbd1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171246 Nov 10 16:01:09.225298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 476/1001] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:09 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:09.301301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:09.302236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:09.308908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.309274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.310051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.310813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.343557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ccbae4a8-a5cc-4d5d-bd70-0a4dc4ee497c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Nov 10 16:01:09.344125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 526/1002] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:09.855626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:09.856478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:09.867263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.867694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.871900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:09.872259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:09.908691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aa9e565c-c310-4233-9de2-c9becf1d013d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057439 Nov 10 16:01:09.909264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 477/1003] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:10.244667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:10.245286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:10.255152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.255953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.257372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.258188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.355417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:10.356420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:10.363285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.363816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.364636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.365120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.396852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-60ed304d-eb67-4691-8dff-851e93fb79f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Nov 10 16:01:10.397457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 478/1004] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:10.402664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:10.411701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:10.413197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:10.414407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bab0accb-c642-440e-8d60-853cae4b2a0b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173598 Nov 10 16:01:10.414963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 527/1005] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:10.921085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:10.922048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:10.928228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.928675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.929495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:10.929903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:10.960735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2052283d-b30b-4e6a-9f1b-c9e170481c86 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Nov 10 16:01:10.961350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 479/1006] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:11.409658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:11.410674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:11.417890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.418375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:11.419181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.419619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:11.433119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:11.433844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:11.440865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.441334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:11.442110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.442576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:11.458680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e372a703-0cde-4153-b6f5-234f492f61e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053568 Nov 10 16:01:11.459271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 528/1007] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:11.593624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:11.604026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:11.605617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:11.607163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-abb49dc0-5745-4be7-ace0-1199f5a4e1ea tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177881 Nov 10 16:01:11.607820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 480/1008] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:11.972591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:11.973410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:11.980932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.981829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:11.982986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:11.983435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:12.017109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-738fc6f0-759e-48a3-a839-faf3320e3d2f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Nov 10 16:01:12.017689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 529/1009] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:12.471776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:12.472684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:12.479414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:12.479770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:12.480571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:12.481002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:12.512267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-26fa34e0-e352-43c8-be63-3d1fb4255c1d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Nov 10 16:01:12.512761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 481/1010] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:12.626444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:12.627037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:12.633711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:12.634132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:12.634975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:12.635409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:12.784811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:12.795040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:12.796715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:12.797960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1dd31b2c-0f34-465e-8d0f-79ae02e63830 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.175552 Nov 10 16:01:12.798550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 530/1011] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:13.030533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:13.031393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:13.038275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.038722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.039559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.039981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.074057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-35ab7b16-c861-41d7-adf6-2a7e9fb13815 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047737 Nov 10 16:01:13.074702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 482/1012] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:13.523550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:13.524477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:13.531823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.532278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.533085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.533533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.565888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-448d40c1-c44c-4fc8-a8ef-de1ceae2150b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Nov 10 16:01:13.566219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 531/1013] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:13.818231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:13.819341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:13.828419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.828861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.829660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:13.830094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:13.973497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:13.983228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:13.984736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:13.985923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-10602c11-3a7f-42e9-b2ca-b5819e158001 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173021 Nov 10 16:01:13.986550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 483/1014] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:14.086828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:14.087636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:14.094689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:14.095153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:14.095946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:14.096377 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:14.128406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-582ca937-9c40-487e-a513-8e2271cc02c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045693 Nov 10 16:01:14.128990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 532/1015] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:14.577808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:14.578746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:14.585256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:14.585716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:14.586554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:14.586984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:14.617851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9944ee45-bca5-4620-9bfd-3bb4647b6e2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Nov 10 16:01:14.618473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 484/1016] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:15.006703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:15.007303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:15.014298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.014899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.015687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.016119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.140340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:15.141410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:15.148439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.148884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.149754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.150142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.163022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:15.173042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:15.174581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:15.176188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-11525968-5a3e-4805-9be8-bbf88c4a2338 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173038 Nov 10 16:01:15.183213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 533/1017] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:15 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:15.198191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-591d3c99-0d26-4f73-82b4-b56b183587a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061555 Nov 10 16:01:15.199120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 485/1018] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:15.629228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:15.630151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:15.637023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.637477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.638311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:15.638948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:15.672728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-54a38bff-2dd2-4cc9-a092-3f4da06388a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Nov 10 16:01:15.673313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 534/1019] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:16.197826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:16.198760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:16.206348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.206801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.207844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.208279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.211830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:16.212779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:16.219627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.220085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.220890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.221319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.273912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-85ca3aa6-9ac4-47d7-b2df-41b81d81567a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066491 Nov 10 16:01:16.274837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 535/1020] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:16.372459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:16.381378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:16.382907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:16.384108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cd691391-c7ae-49c0-bc9d-6c8abad09ca6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.192481 Nov 10 16:01:16.384674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 486/1021] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:16.687206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:16.688155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:16.695148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.695606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.696402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:16.696835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:16.732358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cb7ad9d6-919a-4ef1-91a1-4da0090a80aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050901 Nov 10 16:01:16.733209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 536/1022] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:17.286639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:17.287668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:17.294813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.295296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.296099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.296525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.330054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b4ee736f-25fe-4fdc-be72-5763af8b7b04 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047291 Nov 10 16:01:17.330672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 487/1023] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:17.402913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:17.403553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:17.410680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.411138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.411959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.412388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.564969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:17.573930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:17.575466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:17.577084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73253aa2-ae2d-4d75-b6b0-8921908b2dd8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178470 Nov 10 16:01:17.577657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 537/1024] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:17.747678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:17.748619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:17.755270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.755719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.756529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:17.756961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:17.790633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2269d49b-e4f6-4a04-af05-d608ae76ecfe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Nov 10 16:01:17.791131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 488/1025] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:18.341538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:18.342497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:18.348906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.349360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.350191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.350641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.381799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c232cf2e-a3ad-4664-914b-c451c2bb8ede tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Nov 10 16:01:18.382641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 538/1026] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:18.596555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:18.597133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:18.604277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.604714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.605500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.605923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.744100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:18.754581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:18.756263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:18.758293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8669a12e-9cf0-4269-b468-8247a8825846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165823 Nov 10 16:01:18.759294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 489/1027] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:18.802635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:18.803610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:18.810723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.811169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.811997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:18.812431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:18.844570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f9bac265-55dd-45e4-8596-44aa4aed08a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Nov 10 16:01:18.845153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 539/1028] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:19.393623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:19.394469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:19.401538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.401986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.402833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.403259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.434628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6635aebd-1299-4ce9-a4a7-c4d8ed16a144 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Nov 10 16:01:19.435205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 490/1029] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:19.784978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:19.785575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:19.792432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.792885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.793681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.794271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.856481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:19.858095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:19.865243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.865689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.866509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:19.866949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:19.898299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7aa1e1a1-90f9-4f53-bdbd-a7252ff28289 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Nov 10 16:01:19.902575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 491/1030] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:19.935816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:19.944691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:19.946197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:19.947361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d229ab68-1d2a-4815-ba65-21bc6efb07f6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166310 Nov 10 16:01:19.947899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 540/1031] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:20.446391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:20.447223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:20.454361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.454797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:20.455561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.455979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:20.488957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fe6df1a1-206a-4ded-88c0-d497564cd8b5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Nov 10 16:01:20.489635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 492/1032] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:20.911326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:20.912498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:20.921309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.921908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:20.923038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.923693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:20.958685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73289857-a282-4ab2-a5ff-e21f420eb1cd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051829 Nov 10 16:01:20.959459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 541/1033] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:20.966897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:20.967547 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:20.974498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.974942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:20.975727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:20.976157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:21.121161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:21.130600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:21.132382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:21.133629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d1994689-2ad2-4ec0-bdba-68686b043f8e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171941 Nov 10 16:01:21.134408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 493/1034] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:21.501980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:21.503234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:21.511629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:21.512086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:21.512873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:21.513304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:21.545315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-66dfabbf-a5e6-4475-ba3c-033a2f398100 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047993 Nov 10 16:01:21.545995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 542/1035] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:21.971242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:21.972062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:21.978878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:21.979334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:21.980100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:21.980522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:22.014956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aae666bf-520d-4a0d-96a4-b1ab7917d59f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Nov 10 16:01:22.015505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 494/1036] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:22.155075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:22.155881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:22.162987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:22.163448 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:22.164210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:22.164642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:22.300283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:22.309942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:22.311754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:22.313081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-85029054-c9ef-4926-871e-c1693dff3c34 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.161697 Nov 10 16:01:22.313677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 543/1037] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:22.557853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:22.559345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:22.566263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:22.566688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:22.567467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:22.567898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:22.598115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aa852dd0-e1fa-4a90-a6a6-a20abb920c37 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Nov 10 16:01:22.598903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 495/1038] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:23.030318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:23.031572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:23.041267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.041936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.043130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.043739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.074178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0276ecb3-11c5-4fdc-adc6-6a44cdf61522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050160 Nov 10 16:01:23.074773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 544/1039] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:23.334533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:23.335144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:23.341896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.342345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.343227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.343605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.496203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:23.505915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:23.507419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:23.508564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a5849416-3b1b-41fa-9506-bf94373c000b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178128 Nov 10 16:01:23.509112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 496/1040] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:23.610871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:23.611700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:23.618548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.619033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.619804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:23.620263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:23.651436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6ff39f67-9360-4550-8a81-c64225e36776 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Nov 10 16:01:23.655881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 545/1041] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:24.088705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:24.089927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:24.097794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.098259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.099047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.099484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.133750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c2361d9-f5ce-4bfe-bd41-15dc358fd561 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051469 Nov 10 16:01:24.134362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 497/1042] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:24.527517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:24.528179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:24.534974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.535437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.536221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.536647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.663731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:24.664652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:24.671832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.672554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.673722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:24.674168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:24.694331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:24.703869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:24.705167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4fd411ee-faa4-4aa7-b351-b7ffc2ca5914 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Nov 10 16:01:24.705338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:24.706695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a096e893-b5b6-487b-b8a6-eb66c08e8d60 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.183303 Nov 10 16:01:24.707268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 546/1043] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:24.708964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 498/1044] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:25.148093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:25.149004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:25.156381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.156837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.157635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.158067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.189174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61406be1-35f7-42e7-bdb8-20ad7796affc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Nov 10 16:01:25.189744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 547/1045] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:25.716581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:25.717575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:25.724327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.724768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.725059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:25.725525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.725918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:25.726179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.732596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.733047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.733811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:25.734432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:25.758733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e73bb95f-558c-41ba-9e04-5815bea0eae7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Nov 10 16:01:25.761849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 499/1046] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:25.891076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:25.903677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:25.905191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:25.906384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7f8a72cd-51f9-4640-9049-3465c160ffc7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.185081 Nov 10 16:01:25.907027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 548/1047] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:26.202084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:26.203233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:26.211478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.212020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:26.212998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.213503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:26.250780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9ccf0bb5-c6ca-4822-8473-bfcf218fccd9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052632 Nov 10 16:01:26.250780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 500/1048] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:26.769752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:26.770702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:26.777847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.778348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:26.779194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.779626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:26.814076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-47bc8655-38cb-4330-9d0a-b34a26130b99 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048243 Nov 10 16:01:26.814542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 549/1049] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:26.925902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:26.926460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:26.933381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.933828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:26.934640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:26.935136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:27.080267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:27.089450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:27.090982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:27.092138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-18ad2367-a3ff-4c14-bd24-32f3675be328 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.170523 Nov 10 16:01:27.092693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 501/1050] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:27.261461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:27.262419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:27.269082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:27.269534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:27.270359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:27.270787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:27.302723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-21a7fd3c-c711-4d13-a729-bae135ace85f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Nov 10 16:01:27.303655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 550/1051] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:27.830564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:27.831668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:27.839902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:27.840344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:27.841381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:27.841784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:27.872794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f314d4da-87a8-4247-922f-383a97c487f5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051276 Nov 10 16:01:27.873344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 502/1052] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:28.111401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:28.111994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:28.119262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.119730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.120619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.121049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.277618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:28.287000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:28.288470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:28.289764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-35adf06f-af07-482a-ab6a-0fa8d3a93fc6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.182305 Nov 10 16:01:28.290405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 551/1053] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:28 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:28.320168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:28.321327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:28.329199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.329642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.330501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.330919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.361126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3ac7007b-f45f-45cd-8019-e3f81b949e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Nov 10 16:01:28.361793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 503/1054] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:28.884357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:28.885469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:28.892268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.892717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.893502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:28.893933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:28.931706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eb166dcf-0eb1-4fd3-b68e-e838ecbe66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051227 Nov 10 16:01:28.932291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 552/1055] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:28 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:29.312869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:29.313890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:29.320717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.321348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.321934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.322390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.374503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:29.375578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:29.383020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.383475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.384261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.384769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.414980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b0b4c0da-52ba-4e68-aeb7-08dc79e1aaa6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Nov 10 16:01:29.415536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 553/1056] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:29.469089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:29.484255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:29.486898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:29.488086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-08045922-5dc5-4684-a5e6-feeac1530551 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181503 Nov 10 16:01:29.488656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 504/1057] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:29 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:29.943158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:29.944079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:29.949898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.950379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.951163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:29.951612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:29.982128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-239d8d9f-3ab4-4fd0-9c74-63b271bfa176 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Nov 10 16:01:29.985861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 554/1058] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:30.427766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:30.428684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:30.435542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:30.435990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:30.436780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:30.437204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:30.468760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6ef4b85a-9e54-460f-afc3-5fbe6dace048 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Nov 10 16:01:30.469326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 505/1059] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:30.506885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:30.507438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:30.513890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:30.514384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:30.515159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:30.515579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:30.657701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:30.665906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:30.667433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:30.668571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c41a8f55-9b35-4c4b-b4fc-a7b58a417589 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165618 Nov 10 16:01:30.669117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 555/1060] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:30.993018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:30.993915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:30.999883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.000301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.001092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.001521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.033352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1d140e0b-da0b-4f58-8940-e22d5f9da56a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Nov 10 16:01:31.033920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 506/1061] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:31.483593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:31.484542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:31.491326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.491770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.492534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.492963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.523464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f70b6805-9b1b-4cb2-b5d0-d6feceb59b0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Nov 10 16:01:31.524129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 556/1062] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:31.686973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:31.687576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:31.694591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.695041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.695811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:31.696238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:31.841036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:31.854786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:31.856966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:31.859809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e73ffceb-5d53-4875-b215-896247e25ab2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.176388 Nov 10 16:01:31.860700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 507/1063] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:32.044980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:32.045925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:32.052354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.052815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:32.053603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.054044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:32.086003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0d1e29d3-115e-4bca-a868-84c095ea9f7b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Nov 10 16:01:32.086633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 557/1064] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:32.536518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:32.537460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:32.544411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.544852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:32.545618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.546016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:32.576822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ed9d23e2-b44b-48b4-a686-e6f749171e27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Nov 10 16:01:32.577375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 508/1065] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:32.880889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:32.881478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:32.888232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.888686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:32.889482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:32.889919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:33.035647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:33.044705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:33.046196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:33.047376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61855103-2a23-4d31-803f-1c7c65d9e0f0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171506 Nov 10 16:01:33.047937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 558/1066] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:33.099677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:33.100591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:33.106725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:33.107138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:33.107914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:33.108332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:33.140793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a016ce90-75e4-47fd-9ddb-f89722f86f02 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046199 Nov 10 16:01:33.141337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 509/1067] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:33.589579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:33.590466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:33.597522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:33.598055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:33.598887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:33.599317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:33.631789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7964b123-f278-4451-97d4-2eb344b5b5b5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Nov 10 16:01:33.632354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 559/1068] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:34.070948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:34.071552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:34.078326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.078769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.079681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.080110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.153623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:34.155265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:34.161983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.162382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.163289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.163944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.195879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9bf8f75c-9df6-43b1-800f-6177b1d74404 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046843 Nov 10 16:01:34.196445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 560/1069] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:34.221923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:34.234359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:34.236232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:34.237967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e5b6e7cc-33cf-49a7-ad02-c46893b43d14 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.170684 Nov 10 16:01:34.245100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 510/1070] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:34 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:34.647432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:34.648383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:34.655422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.655872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.656644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:34.657052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:34.687488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d462ec98-e83e-4030-b84c-1705e8677c81 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Nov 10 16:01:34.688041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 561/1071] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:35.207701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:35.208626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:35.215321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.215767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.216599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.216955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.248724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9508f1b1-3cb9-4a00-ba61-e06520558f75 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Nov 10 16:01:35.249552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 511/1072] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:35.260624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:35.261326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:35.268278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.268726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.269532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.269967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.415777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:35.428311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:35.429821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:35.431032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8dcfb7d7-4d1a-40b2-b849-80817c54b6d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.174139 Nov 10 16:01:35.431655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 562/1073] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:35 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:35.701351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:35.702176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:35.708690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.709131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.709894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:35.710357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:35.742993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c35f578-573d-4125-b1d4-2226e59cabd7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Nov 10 16:01:35.743555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 512/1074] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:36.263520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:36.264483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:36.271527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.271963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.272762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.279173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.310558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a4f67220-cfb4-403d-9562-34ec7bb42f93 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051269 Nov 10 16:01:36.311329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 563/1075] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:36 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:36.449123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:36.449765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:36.456380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.456951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.457702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.458134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.597847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:36.607258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:36.608742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:36.609926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e8f2bf53-06e9-403b-ad97-3771b9841445 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.164659 Nov 10 16:01:36.610524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 513/1076] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:36.755634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:36.756594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:36.763153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.763611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.764397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:36.764840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:36.796158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dc5bf5b7-eae3-41ed-ae30-d3cd19ee9ef8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Nov 10 16:01:36.796638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 564/1077] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:37.214904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:01:37.215138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:01:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:01:37.324020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:37.325079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:37.331407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.331975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.332881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.333337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.364818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9868bf96-18e6-44bd-99f4-1db8c910cc52 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Nov 10 16:01:37.365683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 514/1078] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:37.638687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:37.639325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:37.648137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.648591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.649375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.650379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.790051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:37.798828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:37.800326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:37.801634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-59e3e4ad-4511-4e2d-a972-5d266adeb6ee tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169038 Nov 10 16:01:37.802206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 565/1079] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:37.810786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:37.811704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:37.818913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.819352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.820133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:37.820559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:37.857130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8d56af92-3baa-4373-9d36-7ae9c83e19aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049878 Nov 10 16:01:37.857830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 515/1080] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:38.378951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:38.380099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:38.386606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.387053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.387806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.388230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.419212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fccff81d-6c20-4fcd-901a-a31391c7ef67 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Nov 10 16:01:38.419841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 566/1081] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:38 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:38.821140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:38.821758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:38.828745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.829184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.829969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.830445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.873501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:38.874792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:38.881751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.882191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.883011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:38.883444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:38.914413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-905653dd-1d00-4ba4-b58c-954b85e32313 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046869 Nov 10 16:01:38.915103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 567/1082] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:38.972412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:38.980742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:38.982248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:38.983391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87699891-335e-4c0d-a377-7b94cab0d409 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166074 Nov 10 16:01:38.983965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 516/1083] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:01:39.432050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:39.433264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:39.439621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:39.440154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:39.441130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:39.441559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:39.476107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6ecb3631-9958-4656-941f-3ad1a1decbfd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 Nov 10 16:01:39.476685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 568/1084] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:39.925764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:39.926680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:39.933518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:39.933961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:39.935420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:39.935853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:39.968072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6292337d-bfc9-444c-a85a-ef9a18414134 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Nov 10 16:01:39.968646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 517/1085] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:40.010082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:40.010982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:40.021037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.021482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:40.022302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.022732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:40.166478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:40.178393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:40.179885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:40.181054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df2fcfda-e24a-4dd9-92cd-33dab6756a62 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177833 Nov 10 16:01:40.181605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 569/1086] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:40 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:40.488925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:40.489721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:40.495933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.496394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:40.497172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.497591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:40.528492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f210303-0db5-4c38-aa3b-4783a6dd06ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Nov 10 16:01:40.529043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 518/1087] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:40.979852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:40.980765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:40.987515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.988017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:40.988788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:40.989220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:41.018840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3d9ffc8f-216a-4d84-a7a1-23de11fdffaf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042956 Nov 10 16:01:41.019842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 570/1088] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:41.199591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:41.200167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:41.207015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:41.207572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:41.208380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:41.208810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:41.354831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:41.366516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:41.368792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:41.370692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f12dfcba-7f46-43a4-906b-65c3a539281b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.174622 Nov 10 16:01:41.371649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 519/1089] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:41 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:41.540223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:41.541130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:41.547845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:41.548363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:41.549456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:41.550010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:41.580810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aded9d8e-6579-4e70-934e-419d5a8c9535 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Nov 10 16:01:41.581374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 571/1090] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:42.032029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:42.032973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:42.039774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.040204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.041075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.041498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.073162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-de366e02-a734-4087-8ea6-bdfab71911d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Nov 10 16:01:42.073720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 520/1091] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:42.389120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:42.389692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:42.396718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.397230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.398048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.398551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.540578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:42.549683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:42.551255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:42.552431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c7199660-cd14-45dd-a008-5107a5b65491 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167202 Nov 10 16:01:42.553170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 572/1092] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:42.592212 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:42.593162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:42.600647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.601111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.601920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:42.602388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:42.631769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b852e783-3347-4413-a09b-e860e822644a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Nov 10 16:01:42.632332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 521/1093] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:42 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:43.085683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:43.086787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:43.093179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.093626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.094445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.094876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.125755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d882d145-341e-4e5c-b25a-f5083b588dde tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Nov 10 16:01:43.126346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 573/1094] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:43.572623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:43.573231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:43.579771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.580216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.580986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.581412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.644771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:43.646196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:43.653669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.654235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.655085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:43.655630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:43.686091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cc67c085-66be-404a-a46a-e61fc00d8eb4 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Nov 10 16:01:43.686697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 574/1095] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:43.720456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:43.729595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:43.731106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:43.732248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c1af6952-28c1-4751-8112-ba19a027017e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.163558 Nov 10 16:01:43.732815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 522/1096] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:44.139807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:44.141137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:44.150735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.151358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.152454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.153195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.187135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-59a728e7-5fc6-49bc-a209-03ce5c3c5478 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053228 Nov 10 16:01:44.187673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 575/1097] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:44.697200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:44.698103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:44.704628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.705080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.705844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.706456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.737009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f1daaa3-97ee-4a52-a114-d6fe4dab85ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Nov 10 16:01:44.737732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 523/1098] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:44.751710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:44.752328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:44.759503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.759949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.760713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:44.761138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:44.907954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:44.918842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:44.920341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:44.921528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-141597bf-e563-4a14-94c3-eb0570630d2c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173657 Nov 10 16:01:44.922118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 576/1099] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:45.200381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:45.201198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:45.207751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.208191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:45.208971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.209400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:45.240183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ece8f3eb-9363-4b55-b176-e9b37f25fa12 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Nov 10 16:01:45.241097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 524/1100] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:45.748582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:45.749499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:45.756175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.756805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:45.757373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.757800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:45.788452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-94113b48-6d91-4999-8aad-4d95efe2f558 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043733 Nov 10 16:01:45.788994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 577/1101] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:45.944395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:45.944960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:45.951870 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.952309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:45.953087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:45.953549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:46.106492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:46.115379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:46.116832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:46.117992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-21a107d8-60a4-477c-aec0-b719c13a4f96 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177572 Nov 10 16:01:46.118576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 525/1102] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:45 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:46.255725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:46.256956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:46.266142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:46.266720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:46.267588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:46.268158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:46.300414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bf357918-7076-4742-aba6-4e04a8782053 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049601 Nov 10 16:01:46.300939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 578/1103] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:46.800717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:46.801669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:46.808630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:46.809074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:46.809854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:46.810323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:46.843846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cc7329f1-0a37-4131-9951-7d25b99092e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Nov 10 16:01:46.844429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 526/1104] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:46 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:47.139482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:47.140336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:47.149870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.151617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.151617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.152010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.303005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:47.311913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:47.312814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:47.313000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:47.314524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:47.315715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-81b2008e-35c4-4a61-9456-ac56972ad7be tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.182105 Nov 10 16:01:47.316540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 579/1105] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:47 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:47.319083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.319520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.320265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.320876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.350377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6d118bbf-58c3-4b57-9292-f9e615e5fd69 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Nov 10 16:01:47.350932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 527/1106] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:47.856334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:47.857782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:47.867731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.868387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.869608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:47.870272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:47.901025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-78cb4f0a-8757-4de4-b809-ddc3a2c43551 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050216 Nov 10 16:01:47.901665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 580/1107] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:47 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:48.334286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:48.334879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:48.341857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.342392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.343207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.343640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.361396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:48.362376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:48.368708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.369152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.370026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.370509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.402505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-56d80b38-83e0-44bf-8ac9-03029e157bc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Nov 10 16:01:48.403090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 581/1108] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:48.485525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:48.495575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:48.497107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:48.498323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4cbfbac1-9149-4781-85b9-1526e766e7ac tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167914 Nov 10 16:01:48.498867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 528/1109] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:48.911987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:48.912906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:48.919673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.920120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.920902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:48.921329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:48.953955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b2dd43fb-aaa2-4308-b4fc-d68f825f66d5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Nov 10 16:01:48.954600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 582/1110] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:49.418531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:49.419646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:49.429622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.430198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:49.430981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.431421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:49.463489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-09f46b47-1b37-47e5-aac7-8dd761514742 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050793 Nov 10 16:01:49.464195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 529/1111] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:49.517313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:49.517925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:49.525184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.525627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:49.526551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.526997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:49.666443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:49.676064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:49.677572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:49.678843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-35ad29d0-e4b4-4b08-a23c-ff4d9781d736 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165468 Nov 10 16:01:49.679411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 583/1112] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:49.967179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:49.968113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:49.974371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.974820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:49.975609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:49.976039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:50.007627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-050ba70f-ec5a-43c3-9a39-e6af3114f4dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Nov 10 16:01:50.008215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 530/1113] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:50.478226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:50.479634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:50.486472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:50.486930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:50.487742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:50.488230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:50.522545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ed242d5-f217-400b-b6a4-6a5becf1292b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049488 Nov 10 16:01:50.523181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 584/1114] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:50.697717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:50.698380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:50.705578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:50.706048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:50.706861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:50.707292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:50.863092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:50.866348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:01:50.866543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:01:50.871706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:50.873198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:50.874399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0f85093f-5c40-415f-be5d-2bdf0333b413 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180621 Nov 10 16:01:50.874959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 531/1115] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:51.020123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:51.021077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:51.027927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.028367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:51.029310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.030035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:51.064211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-672bdf32-5b33-4766-894a-e8b90b16e233 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047754 Nov 10 16:01:51.064663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 585/1116] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:51.535925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:51.536853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:51.543476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.543961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:51.544697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.545128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:51.575381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cca0777f-6415-47af-b249-16643ede0a83 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Nov 10 16:01:51.575931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 532/1117] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:51.897418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:51.897996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:51.905880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.906364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:51.907144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:51.907583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:52.054609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:52.063622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:52.065100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:52.066315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-57f0ee4a-592b-4137-bd1e-dc81ae5bcade tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173585 Nov 10 16:01:52.066894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 586/1118] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:51 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:52.078478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:52.079401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:52.085901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:52.086382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:52.087152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:52.087575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:52.122086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6e6728b7-3627-4751-bc7e-81d350622b1b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Nov 10 16:01:52.122695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 533/1119] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:52.586761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:52.587621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:52.594305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:52.594704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:52.595478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:52.595924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:52.625146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-397336aa-e3a2-442e-95ab-018b43555f76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042312 Nov 10 16:01:52.625722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 587/1120] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:53.085638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:53.086506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:53.093627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.109251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.110267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.110710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.133749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:53.134684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:53.142966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.143370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.144346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.144960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.176470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-33d1d248-8cee-479f-bee5-3df423ba63cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Nov 10 16:01:53.177337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 588/1121] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:53.305630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:53.315029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:53.316590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:53.317657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-73ab7f78-77c3-41c9-a8c4-b349649662e6 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.236284 Nov 10 16:01:53.318393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 534/1122] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:53.638738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:53.639655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:53.646286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.646750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.647543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:53.647985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:53.680497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-523f9af2-ccad-4d4b-bba4-e5730885f11e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Nov 10 16:01:53.681074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 589/1123] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:54.188464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:54.189381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:54.196022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.196457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.197239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.197668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.228582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-33c3be04-96dd-4b9d-8a34-e49528f7420f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Nov 10 16:01:54.229122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 535/1124] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:54 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:54.340228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:54.340228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:54.347792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.348293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.349180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.349667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.495322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:54.508574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:54.511084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:54.512709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7c07dec8-ebf8-4ca2-8ecd-897ca32f5986 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177322 Nov 10 16:01:54.513268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 590/1125] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:54 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:54.695808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:54.696714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:54.706022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.706642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.707763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:54.708412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:54.749811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-75fd1579-7b6f-4695-aca6-88a04ed3c0be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060534 Nov 10 16:01:54.750437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 536/1126] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:55.241745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:55.244765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:55.249484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.250016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.251274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.251867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.286554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0dff145f-42c4-46a2-a71a-cac13af9a3e7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Nov 10 16:01:55.287147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 591/1127] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:55 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:55.540492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:55.541132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:55.548058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.548481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.549294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.549728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.684188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:55.693285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:55.694779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:55.695930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-756d8f9d-c840-42b5-9d70-07e8dc9a6584 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.159350 Nov 10 16:01:55.696464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 537/1128] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:55.763225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:55.764295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:55.775254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.775861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.776853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:55.777285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:55.808817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0d213473-5a0a-44a7-a0e9-71c9464c58ed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050887 Nov 10 16:01:55.809290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 592/1129] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:56.301069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:56.301983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:56.309229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.309730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.311045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.311742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.347049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e74175e-2aa1-4424-a4d9-5bbe6e18f26f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051743 Nov 10 16:01:56.347610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 538/1130] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:56.720106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:56.720706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:56.727431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.727878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.728652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.729078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.822682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:56.823556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:56.830809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.830918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.831649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:56.832063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:56.863175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cf337b83-f708-46ed-99fe-fc5d44d873d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Nov 10 16:01:56.863733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 539/1131] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:56.886009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:56.895547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:56.896918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:56.898083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa56bb84-1081-42d8-a60e-178ce4a8696d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181913 Nov 10 16:01:56.898694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 593/1132] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:56 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:57.360197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:57.361106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:57.367951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.368391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:57.369165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.369585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:57.400448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-71124446-8440-47cb-b56b-42860e73495a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Nov 10 16:01:57.401012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 540/1133] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:57.875099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:57.876076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:57.882989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.883416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:57.884221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.884770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:57.918825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:57.919747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:57.928468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d07dea01-02e8-446e-8155-b5633abde206 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057123 Nov 10 16:01:57.929008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.929332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 594/1134] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:57.929507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:57.930952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:57.931691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:58.098503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:58.108436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:58.109945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:58.111296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a58f298d-5e54-4712-b668-0c5be28b4edf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.197702 Nov 10 16:01:58.111876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 541/1135] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:01:58.415406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:58.416881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:58.425040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:58.425496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:58.426532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:58.427233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:58.464294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7016c291-2981-4b28-afde-6edca2084154 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054833 Nov 10 16:01:58.465274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 595/1136] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:58.942970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:58.945009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:58.952129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:58.952574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:58.953354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:58.953777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:58.986777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c5c36926-8a92-4125-9b13-39a8c4047bf4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050011 Nov 10 16:01:58.987357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 542/1137] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:01:59.134784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:59.135346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:59.143869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:59.144522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:59.145721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:59.146532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:59.293357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:59.306559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:59.308754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:01:59.310461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a48defa9-332b-48e9-8089-1540e22e20d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181133 Nov 10 16:01:59.311334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 596/1138] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:01:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:01:59.478794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:01:59.479698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:01:59.486041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:59.486454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:59.487213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:01:59.487635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:01:59.528636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b212f431-fd48-457d-98a6-029bd184392f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054462 Nov 10 16:01:59.529199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 543/1139] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:01:59.999433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:00.000393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:00.007001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.007444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.008251 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.008685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.040080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fb44a7b8-486f-4255-8dea-159635388e8e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Nov 10 16:02:00.040860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 597/1140] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:01:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:00.332856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:00.333444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:00.340164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.340623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.341427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.341884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.540838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:00.541770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:00.549082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.549530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.550396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:00.550841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:00.584513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2a86160-4d1e-4b9c-81ff-db7bc1baa8c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Nov 10 16:02:00.585296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 598/1141] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:00.673584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:00.687355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:00.689601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:00.690802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-28cff4d1-635d-4cd3-917c-73a3dc868d3f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.362749 Nov 10 16:02:00.691363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 544/1142] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:00 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:01.053317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:01.054285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:01.060830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.061291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.062088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.062555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.092437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-34944a4a-ae34-496a-8442-27c8db47eee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Nov 10 16:02:01.092999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 599/1143] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:01.599322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:01.600219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:01.606910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.607306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.608067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.608489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.639973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-32f6255e-16e6-4a03-974f-b05dd9783ea1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Nov 10 16:02:01.640741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 545/1144] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:01.709795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:01.710419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:01.717788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.718347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.719222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:01.719724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:01.860011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:01.869418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:01.870948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:01.872107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ff6e49fc-1729-4a45-b4b5-a5ff104153f5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166595 Nov 10 16:02:01.872651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 600/1145] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:02.104897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:02.105841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:02.112597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.113039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:02.113812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.114268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:02.144989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-01c135e2-b97a-4778-9694-12a84be3eaea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Nov 10 16:02:02.145571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 546/1146] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:02.652200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:02.653115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:02.659383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.659833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:02.660611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.661046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:02.691369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b48eea7f-1dd8-4c6e-899d-e00bf852cb50 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Nov 10 16:02:02.691941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 601/1147] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:02.893215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:02.893807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:02.903420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.904034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:02.905148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:02.905706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:03.056394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:03.065588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:03.067077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:03.068248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fd6de8be-a0a8-4d2d-b63d-e9f190fdde6d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.180693 Nov 10 16:02:03.068831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 547/1148] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:02 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:03.157206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:03.158361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:03.165129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:03.165592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:03.166415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:03.166855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:03.198506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-37d199a5-b75a-49f5-a4cb-fccc74f80fd0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Nov 10 16:02:03.199068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 602/1149] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:03.703797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:03.704689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:03.711253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:03.711692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:03.712462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:03.712881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:03.745558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8f4f0873-220c-4721-aefc-394c03d0bace tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Nov 10 16:02:03.746137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 548/1150] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:04.087199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:04.087712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:04.094781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.095280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.096275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.096763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.215060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:04.217028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:04.225123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.225564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.226397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.226827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.256361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:04.258864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e45cad3-2ce2-418c-98ae-2ab4e483b42d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049456 Nov 10 16:02:04.259690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 549/1151] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:04.265555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:04.267064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:04.268234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8730e34d-edf8-4d3a-b2a0-eaa5d0acdf8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.185022 Nov 10 16:02:04.268816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 603/1152] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:04.758775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:04.759670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:04.766190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.766656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.767656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:04.767798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:04.797794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-337ea59c-d854-434c-94af-00c8d6851ab6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042772 Nov 10 16:02:04.798346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 550/1153] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:05.270948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:05.271894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:05.279070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.279511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.280316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.280715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.287339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:05.287951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:05.294833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.295301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.296114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.296546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.313276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a365a77f-4ab9-46a3-b170-0512f27b690e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Nov 10 16:02:05.313864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 604/1154] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:05.437651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:05.446003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:05.447582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:05.448733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fe3e598d-db7d-4005-b1d9-25b7448a38fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165484 Nov 10 16:02:05.449292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 551/1155] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:05.809541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:05.810480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:05.817118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.817559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.818369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:05.818805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:05.850233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f75b03c4-38ac-408f-8907-0359abc0b7dc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Nov 10 16:02:05.850812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 605/1156] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:06.326696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:06.327625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:06.334144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.334621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.335398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.335826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.368927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8bdd15ea-4e4a-46b9-8612-e6dbce03e61d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Nov 10 16:02:06.369530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 552/1157] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:06.469841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:06.470461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:06.477320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.477781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.478601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.479054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.634958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:06.644920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:06.646474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:06.647703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38611f72-afdf-459b-b004-93b34e69e002 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181518 Nov 10 16:02:06.648308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 606/1158] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:06 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:06.863766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:06.864617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:06.871266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.871720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.872736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:06.873168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:06.903944 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-47a85bb1-4e8e-4a7d-a8da-4c4656f25186 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Nov 10 16:02:06.904506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 553/1159] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:07.381041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:07.381958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:07.388727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.389168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.390014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.390390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.419835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fc53b53d-e550-4a57-b285-c6118ba7b60d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042803 Nov 10 16:02:07.420380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 607/1160] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:07.667389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:07.668020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:07.674865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.675303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.676071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.676495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.821553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:07.830310 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:07.831811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:07.833082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-84178cb8-aeba-49f4-80c3-f7b0f0c7fa5d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169512 Nov 10 16:02:07.833634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 554/1161] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:07.916044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:07.916978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:07.923625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.924095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.924892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:07.925399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:07.958763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f480124-f2f1-49fe-8571-1f8ae730a5d9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Nov 10 16:02:07.959328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 608/1162] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:08.431998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:08.432924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:08.439294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.439739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:08.440884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.441369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:08.473118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1c934041-d3b0-49b3-a728-81fa45537497 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Nov 10 16:02:08.473989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 555/1163] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:08.853019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:08.853848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:08.862101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.862597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:08.863381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.863818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:08.970611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:08.971537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:08.978338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.978793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:08.979534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:08.979951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:09.009975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:09.011587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fcc96f32-c621-43b7-907d-c613e39b3c30 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Nov 10 16:02:09.012190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 556/1164] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:09.019153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:09.020656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:09.021821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-14a282a2-56bf-41ed-b6af-753f2a1543a9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.174233 Nov 10 16:02:09.022366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 609/1165] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:08 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:09.488027 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:09.489401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:09.498218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:09.498658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:09.499923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:09.500634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:09.532392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5372f472-b16d-4d5e-8c5d-8593f0627e4d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050071 Nov 10 16:02:09.533149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 557/1166] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:10.024285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:10.025214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:10.031882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.032349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.033677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.034103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.041258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:10.042235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:10.052661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.053286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.054272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.054748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.073488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0012669d-ff53-422b-9635-abddd491f754 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053316 Nov 10 16:02:10.074182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 610/1167] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:10.195825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:10.204968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:10.206517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:10.207768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-739e4b63-b338-407e-8bae-75713b0b4d95 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171464 Nov 10 16:02:10.208240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 558/1168] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:10.545766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:10.546768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:10.553427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.553875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.554681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:10.555115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:10.585434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8045edd0-3b43-43fe-9aa8-0916ff46798a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Nov 10 16:02:10.585987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 611/1169] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:11.088115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:11.089063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:11.099259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.099852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.100938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.101434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.135273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3c266dda-fd88-4108-9568-43e24f3b2bbc tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052958 Nov 10 16:02:11.135863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 559/1170] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:11.232125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:11.232671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:11.239848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.240334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.241345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.241832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.375727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:11.388696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:11.390565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:11.392452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-34439312-4bbe-4d44-acbf-19f46d5bd718 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165964 Nov 10 16:02:11.393391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 612/1171] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:11.598284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:11.599152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:11.605553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.606029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.606824 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:11.607249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:11.639583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-511844d7-602b-4a7c-b25d-4cc6c8391731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Nov 10 16:02:11.640236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 560/1172] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:12.148207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:12.149997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:12.159428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.160037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.161097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.161641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.194530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b4f7f37f-1477-456d-83cb-b909bc5acad0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Nov 10 16:02:12.195099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 613/1173] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:12.412286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:12.412854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:12.419567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.419990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.420767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.421194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.566110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:12.575001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:12.576442 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:12.577654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-99f9f7ec-7e97-43c1-ab5c-a83096d92506 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169297 Nov 10 16:02:12.578239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 561/1174] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:12 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:12.651463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:12.652401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:12.659140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.659601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.660420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:12.660848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:12.694250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f917076a-4836-4e86-baeb-aecf913fc043 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Nov 10 16:02:12.694907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 614/1175] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:13.208359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:13.209709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:13.217622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.218068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.218890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.219312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.250682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-670eebfc-54b3-40f0-ad9a-89dda3cc0309 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 Nov 10 16:02:13.251275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 562/1176] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:13.599378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:13.600153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:13.609586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.610254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.611362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.612085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.710208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:13.710208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:13.717228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.717815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.718706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:13.719245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:13.750741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-510ce3b5-da3b-46b5-b351-2b6986318d92 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Nov 10 16:02:13.754857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 563/1177] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:13.759793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:13.769050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:13.770662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:13.771821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0bd25549-d727-4ca2-a5c1-7bd0741380aa tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178432 Nov 10 16:02:13.772390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 615/1178] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:14.263233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:14.264167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:14.271381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.271828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.272603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.273028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.304135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5fddf247-d355-45ed-850f-f1157ef1c8b8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Nov 10 16:02:14.304693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 564/1179] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:14.762277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:14.763242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:14.770181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.770696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.771479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.771914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.790623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:14.791203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:14.798068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.798562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.799349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:14.799762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:14.803924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4567a0aa-b15e-4576-8fb5-32be8db2502c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Nov 10 16:02:14.804523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 616/1180] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:14.939278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:14.952846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:14.955179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:14.956426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-15db0252-8404-4f6e-bf48-663192537ed3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169535 Nov 10 16:02:14.957019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 565/1181] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:15.318523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:15.319449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:15.327146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.327595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:15.328358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.328789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:15.359583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-83c3848e-9498-4ba5-ae53-1504acefeefe tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Nov 10 16:02:15.360131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 617/1182] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:15.816081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:15.817023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:15.824207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.824652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:15.825443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.825869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:15.857708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-709e7f92-d0f6-47c8-9a43-d5a7e70d94e6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Nov 10 16:02:15.858288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 566/1183] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:15.975614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:15.976194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:15.983011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.983467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:15.984258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:15.984697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:16.122232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:16.132825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:16.134353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:16.135529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-782e1571-04f1-41de-9f65-54b596139699 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.163820 Nov 10 16:02:16.136103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 618/1184] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:15 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:16.371582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:16.372497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:16.378956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:16.379410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:16.380177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:16.380602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:16.410949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cd27434e-382f-4f16-9aee-150f55123928 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Nov 10 16:02:16.411512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 567/1185] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:16.871654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:16.872718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:16.880580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:16.881021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:16.881796 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:16.882255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:16.911754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-26a59311-f117-44a5-a49a-c8a2a256f758 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Nov 10 16:02:16.912327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 619/1186] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:17.154408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:17.155043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:17.161293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.161716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.162517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.162935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.306783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:17.315153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:17.316683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:17.317834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9670e21a-3d09-4050-ad12-7c6649db2b6a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167378 Nov 10 16:02:17.318436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 568/1187] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:02:17.425382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:17.426270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:17.433131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.433570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.434394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.434837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.465529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8cd5e2fa-dfb3-42fc-a55b-aedcd809ed97 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Nov 10 16:02:17.466116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 620/1188] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:17.927351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:17.928268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:17.934686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.935133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.935921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:17.936352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:17.966806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06646439-2ea2-409a-b113-ece6a7455187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Nov 10 16:02:17.967400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 569/1189] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:18.336290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:18.337001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:18.343559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.344010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:18.344800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.345233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:18.477291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:18.478247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:18.484966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.485160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:18.485607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:18.486190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.486625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:18.494321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:18.495897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:18.497103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-81856e95-e309-49c9-be5d-bb5fded811a7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.164695 Nov 10 16:02:18.497741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 621/1190] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:18 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:18.522231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-66e2a187-fc3f-4929-b2d3-286cd426639a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048761 Nov 10 16:02:18.522926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 570/1191] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:18.982521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:18.983649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:18.993433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.994114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:18.995344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:18.995979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:19.028582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fc16da6f-b4a2-4630-9e89-d60add182391 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052418 Nov 10 16:02:19.029132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 622/1192] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:19.516566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:19.517171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:19.524766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:19.525202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:19.525976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:19.526432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:19.536519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:19.537461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:19.544168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:19.544607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:19.545395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:19.545826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:19.577150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d547bdf8-59c9-420f-a613-b41d5c143f60 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Nov 10 16:02:19.577733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 623/1193] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:19.665540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:19.674253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:19.675795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:19.676945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a20a7daf-1abe-418a-a38e-10c5df89f75b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.164325 Nov 10 16:02:19.677513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 571/1194] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:20.041030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:20.041963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:20.048480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.048919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.049721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.050240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.082972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b6530a3b-f405-401a-9ffe-bdba7535531a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Nov 10 16:02:20.083553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 624/1195] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:20.591891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:20.592810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:20.599783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.600253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.601048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.601477 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.632481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b0a1d9ba-654c-4e98-92cf-b039d1988721 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Nov 10 16:02:20.632968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 572/1196] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:20.695240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:20.695892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:20.702774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.703239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.704005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:20.704439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:20.852606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:20.864874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:20.866446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:20.867632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8aff962c-082b-4a8a-b4b4-28f3b9556cb8 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.176242 Nov 10 16:02:20.868205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 625/1197] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:21.095081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:21.095992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:21.102375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.102811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:21.103591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.104757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:21.138086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9859dbb6-d378-4ebd-9112-581a1d3f254c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Nov 10 16:02:21.138669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 573/1198] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:21.644201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:21.645685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:21.653094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.653544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:21.654366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.654801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:21.685483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5575c18f-7d1f-46b8-bfe7-36f4c19ce9f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Nov 10 16:02:21.685950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 626/1199] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:21.885479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:21.886060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:21.893046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.893489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:21.894409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:21.894856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:22.039828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:22.051503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:22.053753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:22.055511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-668641da-27a1-4a69-81a1-9b238d0d63b9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173628 Nov 10 16:02:22.056263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 574/1200] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:21 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:22.150128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:22.151084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:22.158243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:22.158701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:22.159482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:22.159963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:22.191485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-81df9734-95dc-4ed8-8a37-1b2cf55e4ee7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Nov 10 16:02:22.192071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 627/1201] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:22.699232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:22.700149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:22.706188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:22.706666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:22.707481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:22.708030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:22.739296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b165a480-df1c-4356-b894-396688a7b38a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Nov 10 16:02:22.739856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 575/1202] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:23.080091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:23.081058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:23.088237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.088678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.089455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.089891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.203286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:23.204185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:23.210291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.214699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.214699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.214699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.241404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:23.248883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fbcc63e9-cc24-498f-aaa2-90a708c4a4e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049146 Nov 10 16:02:23.250124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 576/1203] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:23.250646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:23.252150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:23.253323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-69b8f49c-86fc-4bad-82ea-d7510a98a20d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.179482 Nov 10 16:02:23.253867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 628/1204] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:23 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:23.755754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:23.756814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:23.763133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.763565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.764324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:23.764738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:23.794981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-83fc2f8f-aa07-4baf-a158-fb13c9b96273 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Nov 10 16:02:23.795540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 577/1205] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:24.263136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:24.264060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:24.270879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.271586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.272136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.272578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.273682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:24.274357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:24.280906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.281362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.282142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.282598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.305560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-345e5061-4c47-4829-b23f-fcbc60420fed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Nov 10 16:02:24.306593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 629/1206] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:24.438734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:24.447599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:24.449070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:24.450298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9cbe7390-9436-43c4-9884-eb3fd5418848 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.182529 Nov 10 16:02:24.450812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 578/1207] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:24.811031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:24.812221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:24.821693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.822360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.823499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:24.824131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:24.857385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-807a2def-cbdf-4328-bb25-cffa595753a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052330 Nov 10 16:02:24.857831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 630/1208] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:25.320080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:25.321516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:25.329532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.329970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.330776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.331205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.370379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3f3e89e1-b893-410c-a865-84d95dd51e86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056072 Nov 10 16:02:25.371100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 579/1209] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:25.468535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:25.469094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:25.476043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.476495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.477275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.477698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.622317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:25.631340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:25.632830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:25.634063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2f15763e-d003-43f1-b80c-e2e9c3107906 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169330 Nov 10 16:02:25.635047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 631/1210] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:25 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:25.870862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:25.871684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:25.879546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.879982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.881111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:25.881519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:25.918177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cea8d640-5d93-4f8a-9877-ebb83eee2e71 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051666 Nov 10 16:02:25.918774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 580/1211] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:26.382573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:26.383516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:26.389765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.390250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.391011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.391440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.422538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d3dbda60-e492-4ae0-a3b9-57c6ae9e4940 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 Nov 10 16:02:26.423138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 632/1212] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:26.655520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:26.656146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:26.664019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.664494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.665277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.665713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.804655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:26.813152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:26.814668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:26.815851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9ae6b3f1-a4f6-48d1-a19c-1facf60e4019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166107 Nov 10 16:02:26.816453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 581/1213] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:26 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:26.932112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:26.932918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:26.939588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.940046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.940829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:26.941263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:26.971704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c824bd8b-292e-4046-afd4-f1c02e6281ad tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 Nov 10 16:02:26.972262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 633/1214] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:27.434720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:27.435679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:27.442484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.442937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:27.443761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.444197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:27.475320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-02a06bf4-51f3-4228-8523-307789bc1b37 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Nov 10 16:02:27.475914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 582/1215] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:27.836596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:27.837206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:27.843719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.844208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:27.844995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.845431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:27.984032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:27.984837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:27.991535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.991976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:27.992753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:27.993154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:28.004479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:28.013263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:28.014781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:28.015944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-98c831d1-97b7-4e31-ac5c-d4d7a1de9ceb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.184291 Nov 10 16:02:28.016918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 634/1216] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:27 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:28.028718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-46a270bd-874e-4708-bed9-260f6d380fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Nov 10 16:02:28.029322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 583/1217] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:02:28.487467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:28.488397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:28.495154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:28.495606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:28.496405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:28.496855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:28.528671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-18c64b24-8753-41d9-af20-ed1189a7daf8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Nov 10 16:02:28.529237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 635/1218] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:29.036992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:29.037584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:29.041135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:29.041604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:29.044560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.045062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.045861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.046327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.048412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.049090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.049861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.050349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.081187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bdcd5816-3727-4e7d-b801-3ef3a376168c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Nov 10 16:02:29.081949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 636/1219] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:29.190270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:29.203625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:29.206076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:29.207882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9be5d367-d82f-4dfc-a78d-06dc89d4af36 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.174695 Nov 10 16:02:29.208810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 584/1220] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:29 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:29.542204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:29.542526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:29.548878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.549327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.550126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:29.550589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:29.581650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ab7271bd-4eb3-4016-9fc7-bc656df9b2e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Nov 10 16:02:29.582432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 637/1221] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:30.092970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:30.093795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:30.100640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.101333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.102150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.102618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.134429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ca8a19fb-c04c-4045-857a-380867d50304 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Nov 10 16:02:30.134989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 585/1222] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:30.227585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:30.228178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:30.235414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.235873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.236658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.237101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.412171 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:30.421164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:30.422687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:30.423873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7d2b4239-77cc-4a85-9a0d-23abd7797490 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.200342 Nov 10 16:02:30.424431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 638/1223] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:30 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:30.593142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:30.594066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:30.600484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.600910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.601698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:30.602126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:30.632400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5650bf43-f48c-46ce-b9ec-c792424dc3ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 Nov 10 16:02:30.632992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 586/1224] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:31.149757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:31.150822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:31.159847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.160389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.161517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.162021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.192705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f4cc0d2e-2775-47bc-bafa-c0a713838cb9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049055 Nov 10 16:02:31.193493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 639/1225] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:31 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:31.444879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:31.445586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:31.455274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.455859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.456937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.457522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.600501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:31.609630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:31.611170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:31.612357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c69f66b9-898f-4d67-9da3-23fb1142ba9d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173553 Nov 10 16:02:31.612928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 587/1226] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:31 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:31.644043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:31.644993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:31.652064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.652528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.653321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:31.653753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:31.684702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-26321fbc-0e3d-4a6c-9700-6e0251eb4787 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Nov 10 16:02:31.685291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 640/1227] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:32.205120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:32.205948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:32.212853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.213298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.214096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.214571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.246311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-98bce0bd-e0f5-4ed8-a619-a72d00c6a106 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Nov 10 16:02:32.246896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 588/1228] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:32.631483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:32.632119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:32.638902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.639358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.640132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.640531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.697185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:32.698305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:32.705471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.705900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.706733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:32.707189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:32.739218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-07f0cb74-59ef-4aa6-9bf0-43111c11f5ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Nov 10 16:02:32.739805 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 589/1229] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:32.782292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:32.794973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:32.797406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:32.799728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6ef2ae28-3ba9-4c25-b350-0be1a53e1bd4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171838 Nov 10 16:02:32.800617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 641/1230] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:32 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:33.260536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:33.261463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:33.268064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.268513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.269333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.269758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.302461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-855e20f0-f612-40e9-9e5e-f83661df5487 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Nov 10 16:02:33.303020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 590/1231] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:33.750456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:33.751374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:33.758106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.758585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.759407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.759834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.794761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3b5f0f62-2472-4fd1-bb88-9831cdd79bcc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047715 Nov 10 16:02:33.795552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 642/1232] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:33.821744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:33.822374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:33.828974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.829410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.830181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:33.830625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:33.972084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:33.980823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:33.982356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:33.983529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3e1911ef-cc8e-4c03-a97b-c6f6309d8176 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166160 Nov 10 16:02:33.984087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 591/1233] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:33 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:34.316217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:34.317394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:34.326843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:34.327537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:34.328652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:34.329313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:34.362877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-29b21e3c-f1ad-4ede-bc9a-be4a4e3ff606 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 Nov 10 16:02:34.363016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 643/1234] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:34.806782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:34.807738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:34.813765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:34.814083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:34.814882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:34.815310 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:34.844932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0e469ec7-426c-4ff1-a4e3-046424f5c4b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Nov 10 16:02:34.845603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 592/1235] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:35.002754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:35.003368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:35.011060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.011513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.012296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.012727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.158526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:35.172260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:35.174783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:35.176717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-12f56896-e256-4838-8ae2-ed349f311846 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.177511 Nov 10 16:02:35.177586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 644/1236] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:34 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:35.376689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:35.377801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:35.385959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.386437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.387215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.387646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.418641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec8726e9-7c72-4bce-913b-4122f5321764 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048108 Nov 10 16:02:35.419214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 593/1237] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:35.856857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:35.857778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:35.864062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.864516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.865299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:35.865729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:35.897251 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73ba1707-1edd-4b21-98b4-cebe516074da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Nov 10 16:02:35.897807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 645/1238] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:36.196555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:36.197145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:36.203661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.204111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.204882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.205315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.348064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:36.357353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:36.358881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:36.360058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6bfa2acf-fbca-4e62-ac3a-574c68d09adc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167419 Nov 10 16:02:36.360613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 594/1239] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:36 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:36.431252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:36.432096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:36.440518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.441130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.442068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.442712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.478184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c263c56f-64c6-4b3e-ba9a-64c4a1b28301 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051011 Nov 10 16:02:36.478823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 646/1240] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:36 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:36.909279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:36.910208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:36.916247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.916681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.917465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:36.917890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:36.950206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cde0ed97-2bfa-4a13-a182-16889fa77fd4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Nov 10 16:02:36.951218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 595/1241] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:37.379920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:37.380518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:37.387340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.387753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:37.388545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.388965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:37.492804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:37.493732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:37.500364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.500812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:37.501593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.502028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:37.532840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-30f8a204-2232-418d-b9d0-ce698b844c2a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Nov 10 16:02:37.533423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 596/1242] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:37.540316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:37.548973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:37.550478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:37.551653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e3251f3d-2c0c-45bc-81cf-9c7bb1c5a442 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.175560 Nov 10 16:02:37.552218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 647/1243] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:37 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:37.965150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:37.966062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:37.972622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.972943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:37.973732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:37.974178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:38.005343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7a178c8d-0dd9-4788-a2b1-609a7b240d21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Nov 10 16:02:38.005908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 597/1244] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:38.546002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:38.547099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:38.556951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:38.557608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:38.558948 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:38.559565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:38.570749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:38.571410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:38.578357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:38.578791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:38.579564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:38.579990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:38.596551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d95fb2d1-0bf9-44f3-b9ee-c3c58ff98d1a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055141 Nov 10 16:02:38.597145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 648/1245] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:38 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:38.721052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:38.730057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:38.731575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:38.732751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-639d5122-4181-4b4a-a005-e54272b2ec7b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165795 Nov 10 16:02:38.733328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 598/1246] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:38 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:39.025182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:39.026653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:39.033830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.034325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.035122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.035552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.065670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b9bc7b3a-9938-4f44-8ce9-0e8a9461cad1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050225 Nov 10 16:02:39.066261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 649/1247] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:39.608709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:39.609507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:39.616481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.616917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.617675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.618305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.649207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6b83d828-7c11-4595-befb-a9e035b51842 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Nov 10 16:02:39.649754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 599/1248] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:39.752201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:39.752812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:39.759733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.760179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.760962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:39.761397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:39.915249 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:39.924501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:39.925999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:39.927200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1795d437-5c26-4f5b-bbf1-3a6b400a4d0e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178869 Nov 10 16:02:39.927762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 650/1249] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:39 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:40.077334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:40.078429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:40.085615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.086054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:40.086885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.087373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:40.118515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e139ba11-0970-4b20-99eb-66c7c3c6d8c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Nov 10 16:02:40.119081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 600/1250] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:40.665996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:40.667015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:40.673938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.674440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:40.675242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.675712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:40.705961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-63a1ac59-8cb0-4103-a758-f4cfeb713e07 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Nov 10 16:02:40.706690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 651/1251] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:40.945323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:40.945975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:40.953007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.953445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:40.954217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:40.954663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:41.095503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:41.110073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:41.112113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:41.113316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e2e48312-42ce-49bc-8893-931c687d9f84 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.171935 Nov 10 16:02:41.113877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 601/1252] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:40 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:41.131743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:41.132666 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:41.139261 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:41.139723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:41.140536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:41.140968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:41.172444 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-90e5a34f-cfbb-4fd8-95c0-24f1ac5477ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Nov 10 16:02:41.173020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 652/1253] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:41.721059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:41.721865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:41.728565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:41.729006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:41.729773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:41.730199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:41.760604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ede17caf-b7e1-4852-9960-25150298a19f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Nov 10 16:02:41.761194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 602/1254] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:42.132671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:42.133368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:42.140470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.140926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.141722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.142191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.185045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:42.187311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:42.194510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.194959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.195906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.202705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.228818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-118667ca-ef75-4831-b857-acfe6919fa40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047993 Nov 10 16:02:42.229394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 603/1255] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:42.282579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:42.295822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:42.298141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:42.300068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-57eb2cd0-5875-4319-91e8-98bea259b314 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.170949 Nov 10 16:02:42.300995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 653/1256] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:42 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:42.772571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:42.773823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:42.780604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.781034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.781799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:42.782252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:42.812647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4457e9ea-7829-44e5-9a19-75c0560916b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Nov 10 16:02:42.813184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 604/1257] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:42 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:43.240776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:43.242084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:43.251103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.251103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.252119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.252667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.287081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b383f591-f1a5-4362-b338-5c33a0a88f36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050099 Nov 10 16:02:43.287661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 654/1258] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:43.322825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:43.323432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:43.329947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.330422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.331169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.331615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.471765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:43.485364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:43.487106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:43.488040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e02b03e-edc6-461f-9e08-c93473226b05 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169134 Nov 10 16:02:43.488574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 605/1259] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:43 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:43.825407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:43.826634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:43.833074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.833511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.834313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:43.834712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:43.863996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e24f8b4f-c3aa-4d6f-9ca7-f1675592e2e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Nov 10 16:02:43.864534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 655/1260] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:44.299495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:44.300713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:44.307787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.308243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.309124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.309551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.341631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1653740a-5c0f-4a96-a229-6d80f4d1a8b8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Nov 10 16:02:44.342304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 606/1261] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:44.509133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:44.510144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:44.516772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.517227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.518001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.518464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.654238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:44.662705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:44.664201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:44.665330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-700b4c18-d8b7-440f-a009-263787587832 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.160323 Nov 10 16:02:44.665884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 656/1262] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:44 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:44.877183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:44.878090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:44.885651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.886141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.887041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:44.887519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:44.920588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4ea0d964-1963-48b1-aecd-cdb58b2435ef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Nov 10 16:02:44.921140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 607/1263] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:45.355803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:45.356882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:45.363281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.363731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.364519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.364955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.395603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58b14aee-1d30-4d9f-a4a5-ce6a9dcd3361 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Nov 10 16:02:45.396174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 657/1264] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:45.684022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:45.684698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:45.691387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.691833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.692652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.693072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.837471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:45.850209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:45.852443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:45.853939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f082e3f7-67ab-4443-a46a-737079cc5517 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.173872 Nov 10 16:02:45.854553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 608/1265] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:45 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:45.933402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:45.934390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:45.941147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.941591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.942409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:45.942838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:45.981219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8b3cecb6-dcd2-4b1e-84e2-b33fbabda193 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051842 Nov 10 16:02:45.981773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 658/1266] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:46.407789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:46.408675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:46.416568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:46.417162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:46.418397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:46.418860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:46.458814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7bebd242-403a-443f-81b7-14b4f0207aaa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054502 Nov 10 16:02:46.459601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 609/1267] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:46.872818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:46.873429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:46.880298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:46.880737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:46.881521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:46.881952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:46.993033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:46.993951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:47.001007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:47.001458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:47.002275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:47.002715 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:47.024932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:47.033465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8a779bb0-b616-453f-afd8-6fdee160f2a5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Nov 10 16:02:47.033953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:47.034451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 610/1268] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:46 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:47.035522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:47.036727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e235a6e9-8228-4573-8ced-ae4cb8d19c68 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167872 Nov 10 16:02:47.037293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 659/1269] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:46 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:47.470611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:47.471496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:47.477936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:47.478390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:47.479435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:47.479865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:47.508472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e3a1131a-52d9-4c8c-a92f-40ebb19ee312 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041570 Nov 10 16:02:47.508921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 611/1270] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:48.047168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:48.048122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:48.055034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:48.055522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.055522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.055736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:48.056304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.056703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.062946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.063387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.064176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.064604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.089160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-35ead643-bef4-4860-9fde-b270cf4506c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Nov 10 16:02:48.089766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 660/1271] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:48.201482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:48.210451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:48.211992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:48.213224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c82d1d6f-3974-4953-9f0b-66b8dcea3c94 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.161920 Nov 10 16:02:48.213761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 612/1272] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:48 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:48.522391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:48.523977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:48.531075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.531529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.532306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:48.532722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:48.562978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-98ded578-3dc5-4fa0-bd2a-c1352b5178f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046155 Nov 10 16:02:48.563541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 661/1273] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:49.100708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:49.101492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:49.108788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.109211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.109996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.110452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.141726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-16ad4d36-6a72-48a5-aaeb-9378a51cc053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Nov 10 16:02:49.142322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 613/1274] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:49.239991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:49.240647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:49.248061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.248397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.249228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.249641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.410244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:49.419940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:49.421477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:49.422668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bdce5c67-7210-4ed3-9d3d-c7426cea6501 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.188410 Nov 10 16:02:49.423368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 662/1275] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:49 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:49.578575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:49.580042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:49.589130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.589686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.590643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:49.591160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:49.625840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0f377c90-4dc5-429a-bc0e-52faef790824 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052037 Nov 10 16:02:49.626409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 614/1276] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:50.154272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:50.155172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:50.161683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.162123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.162929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.163363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.192717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa557929-81ee-4ed5-9e1d-c79c9e06d795 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Nov 10 16:02:50.193255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 663/1277] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:50 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:50.444659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:50.445936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:50.453702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.454122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.454965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.455388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.596528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:50.605145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:50.606664 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:50.607846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0081fc4c-20a8-4c6f-b395-aac409da12fd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169588 Nov 10 16:02:50.608393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 615/1278] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:50 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:50.637036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:50.637947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:50.644687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.645133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.645899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:50.646366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:50.677799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7023fc5a-3deb-4d50-b615-c93a94c34b40 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Nov 10 16:02:50.678387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 664/1279] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:51.205993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:51.206895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:51.214508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.214943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.215862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.216267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.249071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f2fdfac0-7a69-47d4-b0b7-e3c0bf3374e3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047354 Nov 10 16:02:51.249786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 616/1280] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:51.626480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:51.627091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:51.633528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.633981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.634791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.635235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.689044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:51.689992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:51.697301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.697747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.698580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:51.699102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:51.730470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-60689415-e75d-4ba1-bbcc-bf968a159e58 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Nov 10 16:02:51.731081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 617/1281] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:51.789406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:51.799009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:51.800508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:51.801639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-389b5a3e-cc4b-49d9-bced-fc15ca46cc01 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.178996 Nov 10 16:02:51.802219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 665/1282] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:51 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:52.261470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:52.262450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:52.268970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.269416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.270204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.270649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.301357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4f9ed61d-bf35-4c29-a385-2f16e9c29960 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Nov 10 16:02:52.301955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 618/1283] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:52.745841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:52.747320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:52.757566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.758191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.759310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.759892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.792088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-70cc1a61-0c6e-4d58-8265-f61db13ed5da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052528 Nov 10 16:02:52.792766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 666/1284] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:52.819512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:52.820097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:52.826852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.827315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.828127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:52.828553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:52.970779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:52.979933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:52.981421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:52.982650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec552ff2-882f-4af6-b04d-5d2d633829c5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167016 Nov 10 16:02:52.989682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 619/1285] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:52 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:53.313357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:53.314305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:53.320507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:53.320954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:53.321776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:53.322139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:53.351986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f01a75d5-b368-4d46-89c4-3e65d32560a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Nov 10 16:02:53.352703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 667/1286] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:53.804359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:53.805271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:53.811611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:53.812056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:53.812839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:53.813274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:53.843196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-64b0ffc7-d668-4dac-a263-e9a706e857db tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Nov 10 16:02:53.843883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 620/1287] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:54.002250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:54.002922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:54.010291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.010818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.011785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.012282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.152217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:54.161124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:54.162665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:54.163859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-990afe1b-6090-4a59-818c-d28c16ab77ad tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.166042 Nov 10 16:02:54.164427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 668/1288] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:53 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:54.364264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:54.365177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:54.371449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.371889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.372669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.373060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.404390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d7dc15a3-82ba-4803-84df-4d477bd00d84 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Nov 10 16:02:54.404995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 621/1289] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:54 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:54.855312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:54.856298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:54.863034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.863490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.864247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:54.864712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:54.894801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cbfb50d7-a0ab-45cd-82f3-cc27638c988e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Nov 10 16:02:54.895366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 669/1290] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:55.183050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:55.183707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:55.190686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.191123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.191898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.192306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.343588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:55.356268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:55.358610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:55.360351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec9091fa-ff0e-4af6-b6f3-624f477a8b81 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.181055 Nov 10 16:02:55.361077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 622/1291] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:55 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:55.419466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:55.420488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:55.430138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.430715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.431886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.432501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.462754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9bf47563-0f31-4daa-a539-fbd4ac3491f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049288 Nov 10 16:02:55.463692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 670/1292] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:55 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:55.908230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:55.909065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:55.916017 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.916519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.917326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:55.917703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:55.948648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0dbd3ce8-1568-4fbc-af62-f95634626365 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Nov 10 16:02:55.949217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 623/1293] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:56.381712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:56.382575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:56.389992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.390468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:56.391227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.391660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:56.475857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:56.477390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:56.485133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.485571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:56.486387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.486834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:56.518110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-535692f6-6fb8-4af1-9940-3404306ea267 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Nov 10 16:02:56.518724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 624/1294] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:56.532930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:56.542421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:56.543909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:56.545108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44d5fe79-c17e-41f4-be5d-b66303b52214 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.168584 Nov 10 16:02:56.545671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 671/1295] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:56 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:56.962977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:56.964325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:56.970586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.971017 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:56.971778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:56.972196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:57.001492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-950625ac-66ca-4b74-bc33-2f3881a5b4f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Nov 10 16:02:57.002051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 625/1296] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:57.530309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:57.531324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:57.538213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:57.538890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:57.539459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:57.539887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:57.564008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:57.564610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:57.571329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9592a8a2-049c-4b19-bbe9-fdf9d2755cae tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Nov 10 16:02:57.571768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:57.575354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:57.575533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 672/1297] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:57.575658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:57.575658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:57.723670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:57.734228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:57.735772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:57.736978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3365102-59a6-4bb8-bdd8-6abfb0167019 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.176788 Nov 10 16:02:57.737555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 626/1298] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:57 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:58.015286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:58.016195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:58.023174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.023624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.024414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.024846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.055388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cb8366ae-3506-42d8-8e15-42341fb570d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Nov 10 16:02:58.056257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 673/1299] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:58.584134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:58.585070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:58.592364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.592809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.593582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.594001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.624141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-faa4b05a-c769-41e9-99af-ce8e253d3bff tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Nov 10 16:02:58.624705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 627/1300] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:58.756184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:58.756781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:58.764282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.764719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.765488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:58.765885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:58.934691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:58.956454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:58.957946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:02:58.959224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a61c18aa-4536-4db5-b0c6-b2e0c1cbd96d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.206867 Nov 10 16:02:58.959786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 674/1301] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:58 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:02:59.069651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:59.070629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:59.078529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.078977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:59.079766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.080193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:59.114129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c8aaaca8-d58d-42f6-9b29-10cef22dbee3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048669 Nov 10 16:02:59.114732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 628/1302] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:59.637989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:59.638877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:59.646457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.646901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:59.648016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.648458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:59.680276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5b1cc6bc-b55e-4bad-93cf-30dcd591a2ca tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 Nov 10 16:02:59.680863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 675/1303] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:02:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:02:59.978871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:02:59.979598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:02:59.985955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.986436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:02:59.987206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:02:59.987687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:00.126273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:00.127258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:00.130840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:00.134090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:00.134565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:00.135387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:00.135874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:00.139924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:00.141390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:00.142651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-060951eb-67f9-4a1c-91ab-c4b6a9d19613 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.167779 Nov 10 16:03:00.143469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 629/1304] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:02:59 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:00.166905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4a89b78d-74a1-4dd2-817e-fdd24fd88098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Nov 10 16:03:00.167497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 676/1305] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:00.694658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:00.695660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:00.703143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:00.703592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:00.704372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:00.704807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:00.734670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-92472d63-b9ae-45f8-b628-d51185c2d398 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Nov 10 16:03:00.735231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 630/1306] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:01.161604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:01.162334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:01.169441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.169892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.170709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.171150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.178426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:01.179361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:01.185958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.186446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.187231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.187666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.218701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c2278e78-d9b2-4ab2-995f-726c6538f988 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 Nov 10 16:03:01.219353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 631/1307] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:01.315739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:01.324488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:01.325981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:01.327172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e522b172-5c27-43c6-9cee-cfbcba7ee55a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169501 Nov 10 16:03:01.327738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 677/1308] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:01 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:01.747097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:01.748102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:01.754976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.755417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.756189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:01.756612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:01.788023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b1ba8c60-c803-45a2-81ab-930be757a964 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Nov 10 16:03:01.788586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 632/1309] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:02.230864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:02.232021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:02.239269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.239863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.240738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.241195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.274502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-886c51fb-ff04-4798-af0d-9ac55bbe4c46 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Nov 10 16:03:02.275063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 678/1310] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:02.347729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:02.348402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:02.354759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.355220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.356080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.356523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.501752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:02.511391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:02.513170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:02.514400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-08e9a366-0f1b-442f-8c02-33c08cb79c46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.170582 Nov 10 16:03:02.514949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 633/1311] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:02 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:02.800181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:02.801102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:02.807484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.807929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.808875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:02.809278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:02.840344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9e7c7c69-701f-4050-8100-b3c1c37903b2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Nov 10 16:03:02.840902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 679/1312] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:03.287179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:03.288691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:03.297696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.298128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.298997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.299417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.331911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0c7b4c31-8e5e-497b-b6d6-7142a5ee75c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049052 Nov 10 16:03:03.332459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 634/1313] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:03.533391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:03.533977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:03.540627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.541081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.541846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.542307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.701223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:03.709811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:03.711372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:03.712561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e5fd5d24-0554-4a63-af61-19d50952f47c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.182959 Nov 10 16:03:03.713111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 680/1314] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:03 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:03.853694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:03.854914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:03.861882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.862351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.863102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:03.863520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:03.893583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-82a33ea7-769e-45ac-b57d-d5d7718ad5e8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Nov 10 16:03:03.894285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 635/1315] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:04.347318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:04.348663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:04.358134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.358794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.359983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.360576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.394826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a66ccc8e-2f11-48c8-a6d5-6324258293d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053390 Nov 10 16:03:04.395405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 681/1316] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:04.732183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:04.732792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:04.739338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.739760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.740503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.740953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.876461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:04.889161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:04.891708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:04.893474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b380f90-bce7-44f0-b309-ae2d03d5eb10 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.164977 Nov 10 16:03:04.894386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 636/1317] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:04 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:04.907161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:04.908195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:04.916875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.917394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.918946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:04.919754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:04.953872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-420f362e-b6e7-4f91-9d3f-11bb7e497f78 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050722 Nov 10 16:03:04.954504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 682/1318] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:05.243531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:03:05.243852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:03:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:03:05.409432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:05.410656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:05.419044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.419492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:05.420278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.420710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:05.455759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7cb16332-e962-4c6f-bddb-537609a5f9bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052262 Nov 10 16:03:05.456342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 637/1319] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:05.916117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:05.916698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:05.923450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.923900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:05.924671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.925875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:05.969088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:05.970482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:05.980645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.981189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:05.982472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:05.982905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:06.014240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3d8597ed-863a-42f3-8ba1-07c481c7ad6d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051947 Nov 10 16:03:06.014829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 638/1320] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:06.092684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:06.106636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:06.108786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:06.110634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1e089af8-501d-4b96-a7bb-d0f92e421770 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.198086 Nov 10 16:03:06.111383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 683/1321] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:05 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:06.469408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:06.470373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:06.476733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:06.477175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:06.477935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:06.478401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:06.508441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0e3f63e0-65e2-468e-ad10-9b569e8bb81b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Nov 10 16:03:06.508915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 639/1322] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:07.025377 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:07.026313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:07.033364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.033806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.034610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.035036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.134061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:07.134716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:07.141903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.142376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.143195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.143598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.224570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8e89935a-8e77-44c6-844b-a08ba8238d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203286 Nov 10 16:03:07.225357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 684/1323] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:07.287887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:07.299552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:07.301007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:07.302188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-41277b9b-1458-4b55-bf1a-fd987690debf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.172176 Nov 10 16:03:07.302718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 640/1324] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:07 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:07.523401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:07.524742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:07.533286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.533869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.535138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:07.535775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:07.569686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-74de490e-ddaf-4271-ad80-281e0d5227dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052690 Nov 10 16:03:07.570264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 685/1325] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:08.240295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:08.241404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:08.250144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.250599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.251388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.251808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.284433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-50414011-6b36-4875-8906-a15266a3213d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050095 Nov 10 16:03:08.285018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 641/1326] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:08.324354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:08.325045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:08.331719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.332180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.332970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.333408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.469187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:08.478188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:08.479690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:08.480945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6e922cda-9204-4a3e-9fef-8304fd1da3f7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.161973 Nov 10 16:03:08.481516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 686/1327] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:08 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:08.584865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:08.585973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:08.593781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.594260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.595024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:08.595478 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:08.627343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f51d89d9-f0dc-46dd-8c50-91ddf0e7c851 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048497 Nov 10 16:03:08.627915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 642/1328] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:09.295868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:09.296808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:09.303586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.304039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.304819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.305237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.335832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ef03a041-75d1-4185-9af5-ef51f61cb128 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Nov 10 16:03:09.336543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 687/1329] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:09.501861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:09.502464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:09.509179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.509648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.510536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.511028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.644519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:09.646074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:09.655477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.655963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.656766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:09.657189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:09.676286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:09.684637 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:09.686106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:09.687320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06d39c39-aacb-4cba-8f30-b845d52a9369 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.190621 Nov 10 16:03:09.687878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 643/1330] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:09 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:09.689149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a2bc10e4-1880-4bc3-af92-9719eb83c9f2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051744 Nov 10 16:03:09.689727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 688/1331] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:10.347735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:10.348653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:10.355194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.355633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.356490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.357002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.391083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-78e94569-7f42-4bc5-982b-7311307f08f6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047238 Nov 10 16:03:10.391696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 644/1332] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:10 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:10.701813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:10.702835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:10.707615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:10.708207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:10.709244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.709751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.710586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.711004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.714682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.715174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.716020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:10.716482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:10.748047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cc1256e6-9d82-4ae9-8b4e-c5296f2581c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050570 Nov 10 16:03:10.748800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 689/1333] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:10.856562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:10.866195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:10.867905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:10.869268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f10a8140-1b4a-429f-b84a-5b91255ba649 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165323 Nov 10 16:03:10.870601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 645/1334] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:10 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:11.407186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:11.408512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:11.417316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.418005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:11.419292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.420373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:11.451173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-324684c7-5a66-4c9d-8d97-c888b5396db6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049775 Nov 10 16:03:11.451841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 690/1335] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:11.763336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:11.764549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:11.774447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.775004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:11.776102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.776664 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:11.809433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-347422b8-579b-4096-b2f6-38c1d6a8ebf7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Nov 10 16:03:11.810011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 646/1336] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:11.888210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:11.888926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:11.896051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.896519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:11.897803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:11.898291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:12.041525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:12.051083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:12.052573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:12.053758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3487ea9a-916e-4f15-a1ba-021c8710d2dd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.169580 Nov 10 16:03:12.054325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 691/1337] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:11 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:12.463695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:12.464612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:12.472077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:12.472515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:12.473303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:12.473729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:12.504537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c2614b4e-c68e-43d0-b105-4478bcf07f5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Nov 10 16:03:12.505027 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 647/1338] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:12.825277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:12.826446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:12.833518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:12.833971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:12.834794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:12.835237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:12.865337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-939a580b-bf01-49b2-ae20-5b5e9534bccf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045625 Nov 10 16:03:12.865883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 692/1339] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:13.072479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:13.073045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:13.080213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.080572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.081343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.081760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.222733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:13.231149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:13.232652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:13.233801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5dcdadc9-3c2c-46a5-8a12-abb9c6626d46 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.165182 Nov 10 16:03:13.234387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 648/1340] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:13 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:13.518412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:13.521041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:13.529366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.529982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.531123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.531548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.569049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a7b53c18-8d18-4c34-9606-7048ee34e9b0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055979 Nov 10 16:03:13.569622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 693/1341] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:13.879876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:13.880868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:13.888275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.888755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.889714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:13.890194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:13.923526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a79f62a7-1da2-4522-890e-55f26dcadb6d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048465 Nov 10 16:03:13.924101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 649/1342] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:14.252545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:14.253153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:14.259819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.260265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.261045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.261475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.396646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:14.406678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:14.408556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:14.409791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8777e8c5-084c-4e4f-b2e5-d6933c766108 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.161204 Nov 10 16:03:14.410428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 694/1343] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:14 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:14.583830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:14.584801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:14.594862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.595324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.596112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.596565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.628046 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2c9e1fbe-6c6f-46fe-a779-89d25cd3d6a0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050876 Nov 10 16:03:14.628648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 650/1344] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:14.936122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:14.936987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:14.943813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.944308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.945088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:14.945776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:14.978107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b7cee8f1-b987-47d8-9ba8-a71329d699a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Nov 10 16:03:14.978715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 695/1345] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:15.431462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:15.432239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:15.442202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.442869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:15.443655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.444086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:15.602345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:15.613543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:15.616018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:15.617397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c62ebc6a-9cf4-47cc-b165-cffc6d91aad3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.191949 Nov 10 16:03:15.617966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 651/1346] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:15 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:15.639545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:15.640513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:15.646865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.647698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:15.648487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.648925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:15.680723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3f203348-a064-47f7-bbd7-56247afcd161 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Nov 10 16:03:15.681286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 696/1347] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:15.990482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:15.991394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:15.997437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.997883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:15.998700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:15.999126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:16.031206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-564ecee5-410d-4c88-a4db-3896da6cb5b0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Nov 10 16:03:16.031797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 652/1348] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:16.638570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:16.639327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:16.647279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:16.647833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:16.648717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:16.649250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:16.692997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:16.693902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:16.700692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:16.701140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:16.701921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:16.702387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:16.732946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7a3a7c85-7a91-497a-a5ee-3a30f72e7dee tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Nov 10 16:03:16.733524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 653/1349] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:16.791733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:16.804839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:16.807191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:16.808957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c7597c6a-df4f-48c7-8c29-87256717ac25 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.175730 Nov 10 16:03:16.809847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 697/1350] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:16 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:17.047072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:17.048504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:17.057287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.057756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.058563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.058999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.089726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5637b9ab-71e4-42f2-9ef4-f806dd2d8827 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Nov 10 16:03:17.090297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 654/1351] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:17.744887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:17.745818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:17.752688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.753144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.753934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.754405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.785689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a234a7e9-dfec-4349-92cf-5afb1ed00117 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Nov 10 16:03:17.786267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 698/1352] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:17.831538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:17.832116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:17.839562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.840004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.841035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:17.841035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:17.978548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:17.986849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:17.988340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:17.989497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b50d84e9-e7d7-4bcb-86c3-927f4034c170 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.161748 Nov 10 16:03:17.990054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 655/1353] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:17 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:18.103729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:18.104632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:18.111230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:18.111690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:18.112487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:18.112926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:18.144130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2cefbde8-9f2d-48cf-a3fb-fd98dd7220bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Nov 10 16:03:18.144687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 699/1354] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:18.797940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:18.798945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:18.806199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:18.806697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:18.807553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:18.808039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:18.839421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f70a69c4-697e-409d-88fb-351ccf98f63e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Nov 10 16:03:18.840048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 656/1355] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:19.007950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:19.008572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:19.016497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.016986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.017780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.018246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.158388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:19.159666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:19.163420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:19.166630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.167295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.168122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.168549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.173248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:19.174879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:19.176146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bc963694-357e-436d-b555-6802a1127779 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.172269 Nov 10 16:03:19.176778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 700/1356] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:19 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:19.199346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a751bad0-df49-487d-ad7a-6b1d2c1f2cdc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Nov 10 16:03:19.199932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 657/1357] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:19.854689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:19.857736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:19.865076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.865549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.866351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:19.866787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:19.899065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c07fb0a9-209d-4691-81af-bfa2a9e1eb0e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Nov 10 16:03:19.899787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 701/1358] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:20.197415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:20.197991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:20.207380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.207835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.208866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.209357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.214856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:20.215787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:20.222654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.223110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.223955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.224391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.259087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-12f973b1-fddc-41a6-93ff-84429c840c44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048493 Nov 10 16:03:20.260080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 702/1359] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:20.352813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:20.361144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:20.362643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:20.363788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a643ab6c-d7d2-4817-9959-f96bf15ea084 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.172513 Nov 10 16:03:20.364355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 658/1360] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:20 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:20.912813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:20.913785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:20.920295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.920753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.921537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:20.921971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:20.953703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3b691991-7dc6-4b49-b228-e46b85b77f62 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Nov 10 16:03:20.954274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 703/1361] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:21.270812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:21.271731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:21.278766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.279205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.279989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.280420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.311745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-58283964-ef84-4ab5-acbb-832b652efed1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Nov 10 16:03:21.312377 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 659/1362] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:21.386947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:21.387730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:21.394111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.394601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.395400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.395802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.529081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:21.538196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:21.539712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:21.540897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-48778146-0b70-477b-863e-aa7dabf2c3cf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 200 len: 1745 microversion: 2.20 time: 0.163162 Nov 10 16:03:21.541455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 704/1363] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:21 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:21.612739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:21.613388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:21.622450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.623104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.624318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.624961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.911987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0e6e0b17-ca03-407b-8df5-1d5cd7e18be5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments/0cd31d72-058e-429f-b1da-c137b8a15d9f" status: 202 len: 0 microversion: 2.20 time: 0.305312 Nov 10 16:03:21.912576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 660/1364] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Nov 10 16:03:21 2021] DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments/0cd31d72-058e-429f-b1da-c137b8a15d9f => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:03:21.921181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:21.922244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:21.928558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.929050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.929996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.930649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.960232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0044f746-c4d2-4e32-9255-a0c48a520a4e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042938 Nov 10 16:03:21.960807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 705/1365] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Nov 10 16:03:21 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:21.966056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:21.967397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:21.974427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.974908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:21.975697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:21.976128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.006902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-14f6745e-1cb8-4681-ac1f-aa7fba390d03 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Nov 10 16:03:22.007559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 661/1366] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:21 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:22.020864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:22.021355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:22.028003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:22.028468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.029248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:22.029678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.054136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:03:22.060211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.compute.api [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Working on deleting snapshot 7485fcbb-e5c7-4340-9b56-26572b44200a from shelved instance... Nov 10 16:03:22.323787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:22.324381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:22.330928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:22.331412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.332182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:22.332596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.363555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9ec7c1e4-7a69-433c-9b39-7e8fd1c824d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Nov 10 16:03:22.364274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 662/1367] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:22.636522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Doing local delete in cell 27f0e8c4-5c31-4fe0-8e0a-0f5398eec656(cell1) {{(pid=115910) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 10 16:03:22.637438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:22.638028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:22.638621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.compute.api [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 10 16:03:22.646190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] deallocate_for_instance() {{(pid=115910) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 10 16:03:23.019385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:23.020542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:23.028183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.028777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.029593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.030043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.061680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9ea6bb2-7a6c-43d7-866f-7fc9f0ba9e0a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Nov 10 16:03:23.062278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 663/1368] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:23.376298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:23.377240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:23.383320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.383772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.384561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.384992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.416061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-23fdd08c-c05f-4fe0-9749-b53405386910 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Nov 10 16:03:23.416664 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 664/1369] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:23.507213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:23.507701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:23.514095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.514569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.515321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:23.515746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:23.566660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:03:23.566795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:03:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa (ip 10.222.0.60) !!! Nov 10 16:03:23.607579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lazy-loading 'services' on Instance uuid 61231004-dfd0-4036-89ca-e554dfb3876c {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:03:23.687754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [76cc2e70-c84c-4911-a544-bb01e92f2f42] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 10 16:03:23.879381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Updating instance_info_cache with network_info: [] {{(pid=115910) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 10 16:03:24.091156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.scheduler.client.report [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Deleted allocations for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa Nov 10 16:03:24.233536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-18a26be8-1ccb-4b2b-9ecd-bd7deb6959b5 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 204 len: 0 microversion: 2.20 time: 2.216503 Nov 10 16:03:24.237482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 706/1370] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Nov 10 16:03:22 2021] DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 0 bytes in 2218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 10 16:03:24.298872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-e5d8e4ae-fd22-4634-85e8-1594787814ef req-023d6c93-2037-493a-b67e-922e681c6590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30898884-8dbc-4a4a-a1ac-e586e9254eaa", "name": "network-vif-deleted", "tag": "d1fb9f0b-735b-4033-978f-e1637c0ce284"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:24.300462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:03:24.300462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:03:24.307571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-e5d8e4ae-fd22-4634-85e8-1594787814ef req-023d6c93-2037-493a-b67e-922e681c6590 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.307990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-e5d8e4ae-fd22-4634-85e8-1594787814ef req-023d6c93-2037-493a-b67e-922e681c6590 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.319394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.compute.server_external_events [req-e5d8e4ae-fd22-4634-85e8-1594787814ef req-023d6c93-2037-493a-b67e-922e681c6590 service nova] Unable to find a host for instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa. Dropping event network-vif-deleted {{(pid=115910) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 10 16:03:24.320421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-e5d8e4ae-fd22-4634-85e8-1594787814ef req-023d6c93-2037-493a-b67e-922e681c6590 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.084258 Nov 10 16:03:24.321033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 707/1371] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:03:24 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 10 16:03:24.327785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:24.328832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:24.335140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.335603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.336388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.336825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.369032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58b79e35-5689-48b7-8ef9-c12a7cfa4ddf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Nov 10 16:03:24.369602 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 708/1372] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:24 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:24.374189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:24.374815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:24.380678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.381126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.381904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.382420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.396656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. Nov 10 16:03:24.397619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:03:24.398434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-94050fae-4657-4dad-8531-63efd313c836 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 404 len: 111 microversion: 2.20 time: 0.027898 Nov 10 16:03:24.399202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 709/1373] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:24 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 10 16:03:24.407729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-690a7cf4-8ebf-4655-a46b-001bbc26288c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '.version_select at 0x7faa9b5edc10>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:24.428639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-690a7cf4-8ebf-4655-a46b-001bbc26288c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455674392" status: 204 len: 0 microversion: 2.20 time: 0.024733 Nov 10 16:03:24.429189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 710/1374] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Nov 10 16:03:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455674392 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 10 16:03:24.436133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:24.437065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:24.444068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.444519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.445533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:24.445968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:24.478808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ad6351bc-d175-43f5-8f1b-b3f513f98b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048001 Nov 10 16:03:24.479019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 711/1375] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:24.707429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [76cc2e70-c84c-4911-a544-bb01e92f2f42] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46484. Nov 10 16:03:24.711479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c76254ef-75a9-4a17-aa75-b5013f28c43f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c/os-volume_attachments/233ae01f-7234-4402-8838-38907392ce67" status: 202 len: 0 microversion: 2.1 time: 1.208167 Nov 10 16:03:24.715833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 665/1376] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:03:23 2021] DELETE /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c/os-volume_attachments/233ae01f-7234-4402-8838-38907392ce67 => generated 0 bytes in 1210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 10 16:03:25.207928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'create', calling method: .version_select at 0x7faa9b5ed4c0>, body: {"keypair": {"name": "tempest-keypair-158806762"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:25.222851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:03:25.227287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:03:25.384363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:25.385386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:25.392664 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:25.393102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:25.393881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:25.394343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:25.426390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c55f025a-a770-4db4-88f4-400a0e64e942 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Nov 10 16:03:25.426951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 666/1377] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:25.466496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:03:25.470470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:03:25.484332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cbc9693b-c531-4e76-82ea-c9d1066c6bdc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.280228 Nov 10 16:03:25.484927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 712/1378] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Nov 10 16:03:25 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 10 16:03:25.495103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:25.496106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:25.502273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:25.502683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:25.503452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:25.503885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:25.536561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6c7811cc-6206-448c-8f1c-ef95afee078a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049912 Nov 10 16:03:25.537474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 667/1379] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:26.439540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:26.440585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:26.447468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:26.447468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:26.448240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:26.448764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:26.479947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0c34ec8e-fffe-49e4-b474-59827c7967ac tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Nov 10 16:03:26.481008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 713/1380] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:26 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:26.549314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:26.550400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:26.557074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:26.557511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:26.558317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:26.558742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:26.590899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ca96a64c-1111-4cb5-a020-8a6980ee31f3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Nov 10 16:03:26.591408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 668/1381] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:26.872941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1112213772", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b316940-2ac2-4ffe-a852-6ca7feb591f2"}], "security_groups": [{"name": "tempest-securitygroup--1064879346"}], "key_name": "tempest-keypair-158806762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:26.982453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] validate_networks() for [('4b316940-2ac2-4ffe-a852-6ca7feb591f2', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:03:27.437688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:03:27.438284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:03:27.438619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:03:27.439049 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:03:27.439458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:03:27.448846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.449457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.450099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.450582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.468584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for project d0b05ad418584ca19686c99ea57da374. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:03:27.472511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Getting quotas for user 9f70acf2d84d44c896f1d284b84fa9d4 and project d0b05ad418584ca19686c99ea57da374. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:03:27.484074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:03:27.486465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:03:27.492111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:27.493057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:27.500257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.500746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.501565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.501989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.534065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-414e4572-3894-45e8-b093-2b44900d1484 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Nov 10 16:03:27.537974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 669/1382] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:27 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:27.538136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-14441dbd-a10d-440c-bfbf-b979ce191112 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.667068 Nov 10 16:03:27.538136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 714/1383] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Nov 10 16:03:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 10 16:03:27.546951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:27.547569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:27.602606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:27.603841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:27.605283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:27.610121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.610769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.611831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:27.612156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:27.613260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:27.614806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:27.615947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f158566-578e-45d0-b966-899c9cf2557a tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1281 microversion: 2.20 time: 0.073007 Nov 10 16:03:27.616710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 670/1384] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:27 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:27.645069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7c959a34-3428-4e46-8ef7-cbe932fedb84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Nov 10 16:03:27.645886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 715/1385] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:28.545883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:28.547348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:28.555967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.556405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.557175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.557590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.592365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9efd444b-de69-4c0d-b762-c94fd7bde053 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050886 Nov 10 16:03:28.592952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 671/1386] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:28 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:28.634578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:28.635333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:28.644094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.644533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.645314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.645775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.662180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:28.663081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:28.673467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.673922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.674765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:28.675178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:28.717179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dba700ed-3127-4834-999d-4b0fd7643626 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058590 Nov 10 16:03:28.721740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 672/1387] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:28.726860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:28.736338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:28.738073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:28.739273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f1817d48-b869-4e9d-a8f6-7f7be0d217da tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1351 microversion: 2.20 time: 0.109282 Nov 10 16:03:28.740201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 716/1388] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:28 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:29.604416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:29.605609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:29.612258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.612700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:29.613474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.613899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:29.644413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c0b86291-1995-4610-b6ea-70f7facb5364 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Nov 10 16:03:29.644999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 673/1389] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:29 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:29.729525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:29.730514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:29.737163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.737612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:29.738443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.738880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:29.757655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:29.758375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:29.764965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.765631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:29.770708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-692109f1-638f-4eef-942a-3f1b80eea0e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Nov 10 16:03:29.771387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 717/1390] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:29.778213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:29.780105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.029629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:30.040614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:30.043055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:30.044609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f83a1a2c-1e63-4f3d-a7bc-101d1a7e3271 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.291192 Nov 10 16:03:30.045895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 674/1391] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:29 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:03:30.061943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-78f624ca-f07a-4c7b-aea0-62e20c94f5e2 req-352095b9-a138-47d8-a31c-32382707087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5862436c-b538-451b-8764-b38c847b6a22", "tag": "5e7491ee-768e-4525-9b7d-ec8192c5a901"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:30.063303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:03:30.063303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:03:30.080322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-78f624ca-f07a-4c7b-aea0-62e20c94f5e2 req-352095b9-a138-47d8-a31c-32382707087e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:30.080956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-78f624ca-f07a-4c7b-aea0-62e20c94f5e2 req-352095b9-a138-47d8-a31c-32382707087e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.094665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-78f624ca-f07a-4c7b-aea0-62e20c94f5e2 req-352095b9-a138-47d8-a31c-32382707087e service nova] Creating event network-changed:5e7491ee-768e-4525-9b7d-ec8192c5a901 for instance 5862436c-b538-451b-8764-b38c847b6a22 on hv-cinder-81708 Nov 10 16:03:30.102897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-78f624ca-f07a-4c7b-aea0-62e20c94f5e2 req-352095b9-a138-47d8-a31c-32382707087e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045018 Nov 10 16:03:30.104187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 718/1392] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:03:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:30.656531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:30.657473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:30.663953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:30.664396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.665165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:30.665563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.698564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a147a9d0-0c37-4fbe-8a9f-ace53432176f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Nov 10 16:03:30.699457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 675/1393] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:30 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:30.784592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:30.785619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:30.792092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:30.792548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.793622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:30.794135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:30.825679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-81149e26-324d-4aec-9c6c-c051a1fafd20 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Nov 10 16:03:30.826245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 719/1394] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:31.063915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:31.064526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:31.071903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.072404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.073214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.073643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.334106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:31.344563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:31.345955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:31.347085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-987576f5-3e7b-4f31-87bf-12f006bac07e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.287070 Nov 10 16:03:31.347697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 676/1395] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:31 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:31.711284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:31.712313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:31.719070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.719488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.720308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.720728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.751188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-961ef841-2570-4b8e-bcf1-def9b01918ed tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Nov 10 16:03:31.751737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 720/1396] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:31 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:31.839990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:31.840996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:31.848004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.848453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.849304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:31.849660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:31.882874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aa2047f8-834d-41dd-a8a3-ec085f0be3a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Nov 10 16:03:31.883449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 677/1397] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:32.370466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:32.371429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:32.382500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.383244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.384324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.385039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.529819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:32.538051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:32.539587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:32.540746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ed757c35-5f05-4912-a610-977e01561110 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.177127 Nov 10 16:03:32.541391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 721/1398] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:32 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:32.765660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:32.766757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:32.776323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.776915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.778655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.779158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.809156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-285348d4-a333-4e4f-8419-59bfa303cc3d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 Nov 10 16:03:32.809729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 678/1399] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:32 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:32.895549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:32.896353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:32.903868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.904578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.905359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:32.905792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:32.937917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61d4c175-aa27-4da9-93ce-d66c412d803d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Nov 10 16:03:32.938519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 722/1400] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:33.559255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:33.560028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:33.566887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.567324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.568303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.568901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.733580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:33.743599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:33.745732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:33.746932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cad42a5e-8f96-40e0-8b3d-33af28cdd591 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.191461 Nov 10 16:03:33.747654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 679/1401] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:33 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:33.820933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:33.821752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:33.833182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.835009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.837314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.837899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.886732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7167ab27-233c-4c9a-acc6-8e083abefb91 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069788 Nov 10 16:03:33.887312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 723/1402] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:33 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:33.948940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:33.949868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:33.956836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.957617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.958704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:33.959393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:33.993782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b5ee869a-101d-4055-a270-badaeed57548 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048788 Nov 10 16:03:33.994782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 680/1403] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:34.765486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:34.766188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:34.773286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:34.773808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:34.774722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:34.775181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:34.898656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:34.899681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:34.914117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:34.922912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:34.923469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:34.925618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:34.926102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:34.929137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:34.930928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:34.932453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-69fb2189-70ce-465d-b8dc-ee7b178f4003 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.170819 Nov 10 16:03:34.933224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 724/1404] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:34 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:34.970388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e8d5a207-ed35-4bf8-b1b1-5d24c9d9fc8c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075707 Nov 10 16:03:34.971047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 681/1405] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:34 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:35.005950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:35.006914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:35.013278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.013825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.014603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.015037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.046029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-28919976-0e9c-4553-928a-2971135ae785 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Nov 10 16:03:35.046651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 725/1406] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:35.761480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-78b8a8ca-87d2-49fc-bf51-3a662d1eefce req-70b4486d-1418-4bf7-9a77-95ad04c9e22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5862436c-b538-451b-8764-b38c847b6a22", "name": "network-vif-plugged", "status": "completed", "tag": "5e7491ee-768e-4525-9b7d-ec8192c5a901"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:35.762989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:03:35.762989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:03:35.772247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-78b8a8ca-87d2-49fc-bf51-3a662d1eefce req-70b4486d-1418-4bf7-9a77-95ad04c9e22f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.772861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-78b8a8ca-87d2-49fc-bf51-3a662d1eefce req-70b4486d-1418-4bf7-9a77-95ad04c9e22f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.784318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-78b8a8ca-87d2-49fc-bf51-3a662d1eefce req-70b4486d-1418-4bf7-9a77-95ad04c9e22f service nova] Creating event network-vif-plugged:5e7491ee-768e-4525-9b7d-ec8192c5a901 for instance 5862436c-b538-451b-8764-b38c847b6a22 on hv-cinder-81708 Nov 10 16:03:35.789713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-78b8a8ca-87d2-49fc-bf51-3a662d1eefce req-70b4486d-1418-4bf7-9a77-95ad04c9e22f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231863 Nov 10 16:03:35.790741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 682/1407] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:03:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:35.951492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:35.952849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:35.959681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.960134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.960918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.961350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.981466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:35.983589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:35.994452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.995280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:35.996428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:35.997103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:36.036828 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1471d6e5-6470-41c6-8981-4fa2e28f6a48 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059312 Nov 10 16:03:36.037447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 683/1408] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:35 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:36.057559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:36.058543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:36.064445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:36.064871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:36.065638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:36.066082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:36.096615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d4e9d94c-c46d-4549-94a2-a9a8c4692abe tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Nov 10 16:03:36.097072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 684/1409] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:03:36.153710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:36.163552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:36.166799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:36.168868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6f9f5fbf-ce31-48d6-9a52-0f256dd24d44 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.221508 Nov 10 16:03:36.169454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 726/1410] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:35 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:37.048141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:37.049067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:37.055798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.056231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.057024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.057448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.088577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-982324b2-29df-4eb2-9e75-fa0ca09966c0 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Nov 10 16:03:37.089131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 685/1411] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:37 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:37.108430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:37.109346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:37.116239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.116697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.117500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.117940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.189365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:37.190146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:37.198734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.199082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.200130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:37.200651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:37.215513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f43d0e76-2e95-448e-93c3-3536e2bbe8bb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action" status: 200 len: 82102 microversion: 2.1 time: 0.110650 Nov 10 16:03:37.216155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 727/1412] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:03:37 2021] POST /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a/action => generated 82102 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:03:37.356148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:37.364819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:37.366298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:37.367485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c115deb4-f296-4513-8b17-a80eff312fe2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1407 microversion: 2.20 time: 0.183438 Nov 10 16:03:37.368018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 686/1413] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:37 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:38.100995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:38.101989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:38.109308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.109913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.110541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.110971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.143890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f439d8a7-3736-4954-853b-142306cd37a1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046762 Nov 10 16:03:38.144658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 728/1414] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:38 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:38.390763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:38.391365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:38.399742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.400043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.400843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.401266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.557809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:38.566426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:38.567978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:03:38.569175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-88524dcb-ccdf-4044-8896-3b4e0a6d0fb1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1598 microversion: 2.20 time: 0.184188 Nov 10 16:03:38.569727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 687/1415] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:03:38 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 10 16:03:38.589947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:38.590499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:38.597424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.597898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.598749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:38.599197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:38.688454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1821d867-bbf8-4c51-a2e1-5eb863d70362 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102158 Nov 10 16:03:38.689052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 729/1416] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Nov 10 16:03:38 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:03:39.158743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:39.159659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:39.166353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:39.166807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:39.167602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:39.168021 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:39.199718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9d7cc8b-95f8-410f-9ac9-459ef1da1d57 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Nov 10 16:03:39.200294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 688/1417] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:39 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:40.054607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:40.055531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:40.056315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-9a5fb83f-ab50-4dd5-8083-d89554c0c1bb req-68056816-73ba-4b21-b345-1b68678c6a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5862436c-b538-451b-8764-b38c847b6a22", "tag": "5e7491ee-768e-4525-9b7d-ec8192c5a901"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:40.057950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:03:40.057950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:03:40.061713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:40.062173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:40.063058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:40.063579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:40.066107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-9a5fb83f-ab50-4dd5-8083-d89554c0c1bb req-68056816-73ba-4b21-b345-1b68678c6a1e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:40.066674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-9a5fb83f-ab50-4dd5-8083-d89554c0c1bb req-68056816-73ba-4b21-b345-1b68678c6a1e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:40.078579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-9a5fb83f-ab50-4dd5-8083-d89554c0c1bb req-68056816-73ba-4b21-b345-1b68678c6a1e service nova] Creating event network-changed:5e7491ee-768e-4525-9b7d-ec8192c5a901 for instance 5862436c-b538-451b-8764-b38c847b6a22 on hv-cinder-81708 Nov 10 16:03:40.084656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-9a5fb83f-ab50-4dd5-8083-d89554c0c1bb req-68056816-73ba-4b21-b345-1b68678c6a1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Nov 10 16:03:40.085486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 689/1418] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:40.133087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ce632a4-148c-4dfc-a9da-06c6f388ae87 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.082316 Nov 10 16:03:40.133640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 730/1419] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:40 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:03:40.217920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:40.219056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:40.225443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:40.226037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:40.227015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:40.227460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:40.269782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec774c0e-680c-4bbf-9fc1-3adbf9656fef tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061528 Nov 10 16:03:40.269782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 690/1420] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:40 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:41.146789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:41.148481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:41.156020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:41.156518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:41.157306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:41.157721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:41.218992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f9e250a2-cf14-4f84-b710-e80c924a32b0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.078356 Nov 10 16:03:41.219615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 731/1421] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:41 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:41.280749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:41.281795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:41.289126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:41.289754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:41.290772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:41.291235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:41.332362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3c46b56e-2a7a-4fda-8874-4831bb054b40 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055485 Nov 10 16:03:41.333034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 691/1422] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:41 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:42.232970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:42.234484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:42.242697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:42.243211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:42.244043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:42.244432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:42.307892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-337e3fc3-69c5-47a7-b940-3f4e3456920f tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.080782 Nov 10 16:03:42.308747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 732/1423] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:42 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:42.344465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:42.345536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:42.353111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:42.354077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:42.355344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:42.355966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:42.391053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bb75138f-b1d6-480b-ad36-144d7e936d25 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050395 Nov 10 16:03:42.391632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 692/1424] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:42 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:43.324464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:43.325974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:43.334447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:43.334883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:43.335668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:43.336078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:43.400993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7857b285-899e-4b12-bffb-d0229ed046eb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.083515 Nov 10 16:03:43.401703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 733/1425] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:43 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:43.403628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:43.404675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:43.411195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:43.411649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:43.412461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:43.412987 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:43.443498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bdb7d616-465f-411e-82cb-c9a0f693a9eb tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Nov 10 16:03:43.444042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 693/1426] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:43 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:44.413111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:44.414792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:44.422193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:44.422691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:44.423692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:44.424135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:44.454583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:44.455905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:44.462933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:44.463456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:44.464272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:44.464699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:44.494707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38fccb78-c0f5-45d1-9fa9-e96cab2d8e2e tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.085563 Nov 10 16:03:44.495347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 734/1427] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:44 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:44.496180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-90664d27-c9de-466c-9158-7ca0e2f956a6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Nov 10 16:03:44.496904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 694/1428] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:44 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:45.505821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:45.506878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:45.507910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:45.508922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:45.513779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:45.514355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:45.515062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:45.515490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:45.515993 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:45.516112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:45.516847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:45.517288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:45.548340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4f715517-93da-47e7-aaa7-b8559053be3b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Nov 10 16:03:45.548966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 695/1429] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:45 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:45.582203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-771699f6-77ac-4513-9130-e436bc538fcf tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.080294 Nov 10 16:03:45.582870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 735/1430] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:45 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:46.561126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:46.562127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:46.569005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:46.569436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:46.570248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:46.570673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:46.593735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:46.594855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:46.601119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-34acf4d3-a6a5-459f-9aa6-1430a60d1a88 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Nov 10 16:03:46.601692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 696/1431] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:46 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:46.601955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:46.602457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:46.603252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:46.603683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:46.665432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-77f6b5cd-f6d1-416b-8287-cda66f3499c1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.075747 Nov 10 16:03:46.670299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 736/1432] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:46 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:47.613372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:47.614312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:47.621116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:47.621564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:47.622391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:47.622825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:47.654992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-27567734-ed20-4a4c-bbf1-6a32137e032e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Nov 10 16:03:47.655555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 697/1433] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:47 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:47.680540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:47.681582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:47.689142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:47.689620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:47.690450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:47.690886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:47.751966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-29775287-900c-49be-8f5b-82048d930915 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.075012 Nov 10 16:03:47.752723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 737/1434] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:47 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:48.667123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:48.668088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:48.675178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:48.675634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:48.676411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:48.676835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:48.711589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d78bcc34-50dd-4890-9ae1-4aa6afeb3f74 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047855 Nov 10 16:03:48.712299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 698/1435] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:48 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:48.768486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:48.769750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:48.780937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:48.781583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:48.782512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:48.782949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:48.844374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d32e25c0-c119-401b-93e7-554ac012bb85 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.081804 Nov 10 16:03:48.845309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 738/1436] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:48 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:49.724916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:49.725837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:49.732459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:49.732897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:49.733682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:49.734105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:49.764638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9a6fef52-7767-488f-8462-e7c257b95413 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Nov 10 16:03:49.765187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 699/1437] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:49 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:49.856787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:49.857796 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:49.865449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:49.865899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:49.866731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:49.867170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:49.933842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aad37c9a-daad-4a4d-bdf0-67e3a3ebc4fb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 14 microversion: 2.20 time: 0.081065 Nov 10 16:03:49.934517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 739/1438] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:49 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:03:50.776822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:50.778653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:50.785307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:50.785899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:50.786744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:50.787178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:50.818515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7a87c72d-ed95-48e5-99b8-8fd093de3831 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Nov 10 16:03:50.819072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 700/1439] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:50 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:50.947199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:50.948190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:50.957258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:50.957258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:50.957649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:50.957877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:51.039057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f26575ad-7770-48c2-9a21-52dd48786145 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 12411 microversion: 2.20 time: 0.095295 Nov 10 16:03:51.039861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 740/1440] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:50 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 12411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 10 16:03:51.830181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:51.831127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:51.838186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:51.838688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:51.839501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:51.839931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:51.870098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-03283b22-a6cd-4391-a4a0-356e0895e20e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Nov 10 16:03:51.870719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 701/1441] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:51 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:52.053291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:52.054410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:52.061483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:52.061915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:52.062724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:52.063151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:52.139157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a05b5059-8a05-458c-8188-5882075265bd tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 18498 microversion: 2.20 time: 0.090087 Nov 10 16:03:52.139975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 741/1442] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:52 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 18498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:52.880934 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:52.881874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:52.890878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:52.891320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:52.892099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:52.892521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:52.929111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-52028c62-a91c-4147-bd08-a0c598e681cf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051910 Nov 10 16:03:52.929685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 702/1443] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:52 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:53.151891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:53.152907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:53.160416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:53.160991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:53.161886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:53.162352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:53.246313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-10ffcf96-07d9-4260-900a-8252d9b8c247 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 19342 microversion: 2.20 time: 0.097980 Nov 10 16:03:53.247273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 742/1444] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:53 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 19342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:53.941173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:53.942431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:53.948980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:53.949424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:53.950217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:53.950673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:53.980302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-353c5df8-c5de-40a7-bc91-edec6446dc2b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Nov 10 16:03:53.980854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 703/1445] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:53 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:54.261003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:54.262041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:54.269399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:54.269912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:54.270823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:54.271598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:54.358038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e1d391cb-a045-4142-a382-711b0dd0ac91 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 22021 microversion: 2.20 time: 0.101130 Nov 10 16:03:54.358769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 743/1446] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:54 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 22021 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:54.994123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:54.995348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:55.002397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:55.002842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:55.003634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:55.004065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:55.038490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-92463fdc-c139-4f22-88e0-84cbfdc4779d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048128 Nov 10 16:03:55.040129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 704/1447] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:54 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:55.371369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:55.372351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:55.379776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:55.380250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:55.381360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:55.381782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:55.457555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-31bef171-b19b-4e61-baf6-d5fb1f00856b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 23235 microversion: 2.20 time: 0.090383 Nov 10 16:03:55.458262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 744/1448] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:55 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 23235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:56.053224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:56.055777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:56.066713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:56.068495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:56.069417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:56.069896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:56.271655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-78f0fe5d-d170-4652-9e9a-392794c2c6fd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224500 Nov 10 16:03:56.272441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 705/1449] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:56 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:56.469787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:56.471024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:56.478761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:56.478990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:56.479869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:56.480159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:56.560050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3c1ba77f-b6fb-4799-91bd-bbd29ed3d6d2 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 24958 microversion: 2.20 time: 0.094217 Nov 10 16:03:56.561609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 745/1450] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:56 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 24958 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:57.284144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:57.285049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:57.291699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:57.292146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:57.292930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:57.293354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:57.324252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7744e66f-90e0-4577-a921-22c6c17405c1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Nov 10 16:03:57.324859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 706/1451] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:57 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:57.572703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:57.573655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:57.580657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:57.581102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:57.581891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:57.582371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:57.669629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7a4cffa5-e307-4222-ae26-b1775f39a4cb tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 26508 microversion: 2.20 time: 0.100974 Nov 10 16:03:57.670356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 746/1452] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:57 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 26508 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:58.339108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:58.340510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:58.350515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:58.350971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:58.351767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:58.352201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:58.383516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-db666462-b602-4c03-99ac-b9868c73a5dd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050020 Nov 10 16:03:58.384096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 707/1453] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:58 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:58.681771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:58.682818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:58.689843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:58.690326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:58.691105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:58.691536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:58.778067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-189a8faf-c7aa-498f-a233-bbe6e8e1e5fc tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 27660 microversion: 2.20 time: 0.100332 Nov 10 16:03:58.778851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 747/1454] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:58 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 27660 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:03:59.398337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:03:59.399233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:59.405861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:59.406342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:59.407118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:59.407543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:59.438821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-316dac1d-0a30-4ea3-afd3-953382058de7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046192 Nov 10 16:03:59.439376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 708/1455] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:03:59 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:03:59.792394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:03:59.793429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:03:59.801059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:59.801513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:59.802452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:03:59.802825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:03:59.880414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61c53180-d8e7-4299-a1c6-6fad51422d8b tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28160 microversion: 2.20 time: 0.091811 Nov 10 16:03:59.881458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 748/1456] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:03:59 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28160 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:00.451841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:00.452747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:00.459490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:00.460134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:00.460916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:00.461327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:00.492441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d7962420-6188-48b5-aad3-0447708e47b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Nov 10 16:04:00.492997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 709/1457] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:00 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:00.898051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:00.899264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:00.911066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:00.911714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:00.913029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:00.913743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:01.000385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7fdf6af3-caf4-4940-a3c0-a6b5a2be4311 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28243 microversion: 2.20 time: 0.107832 Nov 10 16:04:01.001305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 749/1458] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:00 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:01.505882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:01.506841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:01.514291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:01.514736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:01.515541 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:01.515972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:01.549522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-af0501c7-57c6-43b5-a006-96d6999859a7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049109 Nov 10 16:04:01.550739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 710/1459] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:01 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:02.015078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:02.016072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:02.023692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:02.024255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:02.025000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:02.025442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:02.111335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ed66890-fc72-4b05-9b25-426dd3734d27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28438 microversion: 2.20 time: 0.099529 Nov 10 16:04:02.112206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 750/1460] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:02 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:02.564221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:02.565283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:02.574420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:02.574965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:02.575945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:02.576448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:02.612549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0bc951fb-3f0e-4736-8c8e-f93006fd0a9e tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054053 Nov 10 16:04:02.613132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 711/1461] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:02 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:03.126130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:03.127174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:03.134507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:03.134976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:03.135794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:03.136236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:03.213763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b6ad60a9-6e44-4e24-a0a0-54d6692079d0 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28677 microversion: 2.20 time: 0.091467 Nov 10 16:04:03.214350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 751/1462] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:03 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28677 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:03.625730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:03.626671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:03.634990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:03.635657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:03.636609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:03.637052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:03.668545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bdbf1d6a-d220-4f88-85d7-43e95b24a65f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Nov 10 16:04:03.669329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 712/1463] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:03 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:04:04.230817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:04.231951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:04.239328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:04.239774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:04.240577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:04.241043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:04.325718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5b3b1cf-a5c9-4e4b-901e-2cdc3a684d99 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28702 microversion: 2.20 time: 0.101304 Nov 10 16:04:04.326550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 752/1464] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:04 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28702 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:04.680829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:04.681733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:04.688703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:04.689189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:04.689960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:04.690427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:04.721086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d20976e8-cc84-459e-a606-4565f87396cd tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Nov 10 16:04:04.721627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 713/1465] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:04 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:05.338782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:05.339693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:05.347173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:05.347619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:05.348402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:05.348832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:05.411634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4af242d2-1d4f-45b1-97c7-57663b285b54 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28702 microversion: 2.20 time: 0.076991 Nov 10 16:04:05.412294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 753/1466] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:05 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28702 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:05.733492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:05.734780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:05.741766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:05.742264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:05.743059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:05.743491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:05.776215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-966d6d6c-17ac-480c-8789-d836ef316861 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047555 Nov 10 16:04:05.776798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 714/1467] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:05 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:06.425067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:06.426057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:06.433734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:06.434188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:06.435010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:06.435435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:06.501252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b75365cb-b821-49db-af61-13e2e91c213d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 28702 microversion: 2.20 time: 0.080171 Nov 10 16:04:06.501790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 754/1468] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:06 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 28702 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:06.790890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:06.791980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:06.800479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:06.800957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:06.801764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:06.802189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:06.832747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-63693d77-1434-4977-9a4d-fdfe8a7c2458 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047746 Nov 10 16:04:06.833291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 715/1469] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:06 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:07.514015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:07.515114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:07.522913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:07.523358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:07.524152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:07.524586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:07.602450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-721a86e8-327f-4c95-a05e-215aac4ad876 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 30842 microversion: 2.20 time: 0.092426 Nov 10 16:04:07.603113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 755/1470] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:07 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 30842 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:07.846647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:07.847459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:07.854444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:07.854879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:07.855636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:07.856055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:07.887784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-473a7f86-3574-424b-9abc-cc1b8ed38252 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Nov 10 16:04:07.888567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 716/1471] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:07 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:08.617776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:08.618794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:08.627675 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:08.628128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:08.628914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:08.629357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:08.711023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c507fa9b-7a2d-436b-8cda-0e9dbe3dfb6c tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 32834 microversion: 2.20 time: 0.099572 Nov 10 16:04:08.711657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 756/1472] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:08 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 32834 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:08.903855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:08.904842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:08.912029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:08.912474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:08.913253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:08.913740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:08.943493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-08ba671b-691c-4828-906c-d8b7b318b464 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Nov 10 16:04:08.944068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 717/1473] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:08 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:09.724256 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:09.725248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:09.732035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:09.732476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:09.733250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:09.733683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:09.808985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-631c3bbd-62ec-4d32-92ff-d8562ba322b3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 33753 microversion: 2.20 time: 0.088521 Nov 10 16:04:09.809708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 757/1474] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:09 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 33753 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:09.956095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:09.957029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:09.963768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:09.964110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:09.964904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:09.965366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:09.997802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ff1065a3-049c-453f-bec9-94ced993c8b1 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Nov 10 16:04:09.998418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 718/1475] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:09 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:10.823362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:10.824688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:10.835638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:10.836218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:10.837430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:10.838031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:10.916082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b2385ea3-cec7-47ad-98be-a0b2230eea61 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 35045 microversion: 2.20 time: 0.098390 Nov 10 16:04:10.916738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 758/1476] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:10 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 35045 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:11.010582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:11.011528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:11.018650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:11.019026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:11.019810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:11.020242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:11.052973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-698a76ef-9fdf-426f-9397-87eeca63a2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 Nov 10 16:04:11.053599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 719/1477] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:11 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:11.931733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:11.932896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:11.941333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:11.941782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:11.942633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:11.943075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:12.023501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75f7ceb8-d94f-4de6-8dd7-d775048c497d tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 36577 microversion: 2.20 time: 0.097980 Nov 10 16:04:12.024164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 759/1478] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:11 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 36577 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:12.065513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:12.066425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:12.073619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:12.074069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:12.074851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:12.075309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:12.107285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a19704f9-f229-403b-a471-54bd50853954 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Nov 10 16:04:12.108042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 720/1479] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:12 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:13.040268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:13.041579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:13.050546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:13.050994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:13.051774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:13.052210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:13.121329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:13.122634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:13.131398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:13.131398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:13.131398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:13.133383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:13.136988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-815e4d64-339b-48dc-a44f-0f6f3b97adb3 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 38155 microversion: 2.20 time: 0.102883 Nov 10 16:04:13.137833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 760/1480] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:13 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 38155 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:13.165193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-182e376b-8a04-4250-9a3e-86b4966058b9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049477 Nov 10 16:04:13.165776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 721/1481] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:13 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:14.151001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:14.152050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:14.159953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:14.160400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:14.161269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:14.161687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:14.181146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:14.182109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:14.188968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:14.193375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:14.194567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:14.194774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:14.229267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cfac3f31-3553-44e9-9091-e8f414555902 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055542 Nov 10 16:04:14.230060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 722/1482] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:14 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:04:14.244812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4aa70424-b9e3-45c8-bf4b-e782e69b1d69 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 38261 microversion: 2.20 time: 0.097830 Nov 10 16:04:14.245873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 761/1483] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:14 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 38261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:15.241798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:15.242746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:15.249740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:15.250189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:15.250995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:15.251419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:15.257641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:15.258767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:15.266283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:15.266852 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:15.267768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:15.268286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:15.286198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ad0b0cc8-c7d6-41c8-95df-43b15fdb0d7d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Nov 10 16:04:15.287194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 723/1484] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:15 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:15.334149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-30e021ae-d37a-4aaa-8b51-356d3823f495 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 38261 microversion: 2.20 time: 0.080344 Nov 10 16:04:15.334825 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 762/1485] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:15 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 38261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:16.303130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:16.304419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:16.315587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:16.316181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:16.316862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:16.317292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:16.348367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:16.349599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:16.350396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e275ef98-47d1-4376-85c5-1350209e15a9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054263 Nov 10 16:04:16.351188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 724/1486] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:16 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:16.362974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:16.363439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:16.364263 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:16.364699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:16.428705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a08aac29-784f-4948-86c1-feccf1f186a1 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 38261 microversion: 2.20 time: 0.085191 Nov 10 16:04:16.429667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 763/1487] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:16 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 38261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:17.364845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:17.365680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:17.372375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.372736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.373463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.373861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.404850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a7283758-0b2e-4f95-9bc7-796d67febbe9 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Nov 10 16:04:17.405404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 725/1488] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:17 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:17.441885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:17.442919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:17.450303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.450755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.451546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.451978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.528222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4615eae4-3a72-4ddb-936e-1acc13846bff tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action" status: 200 len: 38404 microversion: 2.20 time: 0.090773 Nov 10 16:04:17.529510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 764/1489] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Nov 10 16:04:17 2021] POST /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/action => generated 38404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:04:17.539133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:17.539623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:17.545664 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.546093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.546913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:17.547329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:17.570401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a25d00b6-1287-4e1d-a9cc-b321e34dc289 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/ips" status: 200 len: 151 microversion: 2.20 time: 0.034920 Nov 10 16:04:17.570952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 726/1490] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Nov 10 16:04:17 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:04:18.419618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:18.420724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:18.429844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:18.430518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:18.431995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:18.432620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:18.467222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ad3da9c7-9232-487a-9f57-b83a3aa196a8 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053194 Nov 10 16:04:18.467879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 765/1491] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:18 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:19.479163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:19.481348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:19.486437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:19.486751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:19.487511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:19.488069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:19.518297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-42c1555f-c673-4faa-8ca7-08b85b40af10 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Nov 10 16:04:19.518936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 727/1492] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:19 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:20.531476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:04:20.532309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:20.539812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:20.540243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:20.541018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:20.541440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:20.572834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e7457dff-45b0-4b54-ae2b-74266467056a tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Nov 10 16:04:20.573418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 766/1493] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:04:20 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:04:21.585896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:04:21.586827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:04:21.594778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:21.595302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:21.596189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:04:21.596675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:04:21.675995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-94eb7733-eb44-4832-ace3-f3f28c85cd7f tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/action" status: 200 len: 40564 microversion: 2.1 time: 0.093926 Nov 10 16:04:21.676780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 728/1494] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:04:21 2021] POST /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9/action => generated 40564 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:06:25.262661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:06:25.263338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:06:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:06:37.241927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:06:37.242542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:06:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:06:43.585419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:06:43.586039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:06:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:06:49.913451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:06:49.914001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:06:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:08:30.890972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:08:30.891906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:08:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:09:24.039561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 10 16:09:24.044023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:24.044524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:24.053247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:24.053880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:24.054527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:24.054966 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:24.082698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:09:24.167085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-51fe8a5c-0da2-490e-8eb7-1bc5457e441b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 204 len: 0 microversion: 2.1 time: 0.128995 Nov 10 16:09:24.167897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 767/1495] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:09:24 2021] DELETE /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:09:24.174854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f9a7afd-30b2-4387-bac9-ba645cad199c] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 10 16:09:24.178698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:24.179411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:24.185548 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:24.185989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:24.186930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:24.187389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:24.415446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:24.424216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cb00c0be-f839-4af7-8fbb-a20d1421dbc4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.251606 Nov 10 16:09:24.424761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 729/1496] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:09:25.446687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:25.447758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:25.474454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:25.474904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:25.475687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:25.476121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:25.492204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50192. Nov 10 16:09:25.680012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:25.688555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-14a0553a-40de-42db-8ab9-32f318d849cc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.249320 Nov 10 16:09:25.689122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 768/1497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:26.704749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:26.705439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:26.721982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:26.722380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:26.723151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:26.723575 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:26.728434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f9a7afd-30b2-4387-bac9-ba645cad199c] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50208. Nov 10 16:09:26.862578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:26.870543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06017e9d-7146-4401-b754-5a464a2911e1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169459 Nov 10 16:09:26.871152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 730/1498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:26 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:27.891566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:27.892409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:27.899927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:27.900391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:27.901185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:27.901619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:28.045885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:28.054242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75355a77-9f8c-4a7b-88d4-2f232a67213e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169309 Nov 10 16:09:28.054832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 769/1499] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:29.075192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:29.076116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:29.087328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:29.088016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:29.089199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:29.089953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:29.239146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:29.247615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3c8cc5c-a0ea-478a-a006-4cb6850ac81b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.178834 Nov 10 16:09:29.248190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 731/1500] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:30.268699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:30.269306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:30.276011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:30.276461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:30.277239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:30.277672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:30.416406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:30.424393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8e04459e-26ce-44c0-bc21-a59f7308da54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161987 Nov 10 16:09:30.426758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 770/1501] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:31.441830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:31.442894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:31.450095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:31.450520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:31.451368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:31.451787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:31.589192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:31.597627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f5882f15-1c46-4cfc-bb32-6acc9064abfa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160465 Nov 10 16:09:31.598495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 732/1502] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:32.617869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:32.618686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:32.627118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:32.627678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:32.628721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:32.630009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:32.785824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:32.794788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4cd2a694-c6e7-49f8-840a-0c8f02274efa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182019 Nov 10 16:09:32.795353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 771/1503] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:33.816954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:33.817522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:33.824304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:33.824788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:33.825626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:33.826064 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:33.970733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:33.989621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f05ba2ca-f86b-476c-a3e1-b1440f5e734d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179114 Nov 10 16:09:33.990199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 733/1504] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:33 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:35.007509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:35.008152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:35.015060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:35.015524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:35.016304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:35.016741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:35.169458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:35.177932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8e6df5b1-d8fa-422f-a7c3-d02dd3b261e0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174331 Nov 10 16:09:35.178589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 772/1505] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:35 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:36.199267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:36.200180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:36.209699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:36.210130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:36.210980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:36.211410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:36.354211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:36.364900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-af5c9afa-938e-41e1-8ea7-c5cfbcb0cc0a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171946 Nov 10 16:09:36.365473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 734/1506] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:37.385320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:37.385956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:37.394052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:37.394585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:37.395441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:37.396006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:37.551594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:37.564113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f36331f-5b82-4333-b8b1-b75bb1412355 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182779 Nov 10 16:09:37.565051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 773/1507] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:38.585468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:38.586072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:38.592574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:38.593005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:38.593764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:38.594194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:38.740118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:38.752227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c2a09fb3-a93e-4e84-8b16-e2f12b9fb4c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171996 Nov 10 16:09:38.752768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 735/1508] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:39.772348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:39.773174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:39.779977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:39.780423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:39.781207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:39.781646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:39.920723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:39.928616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df8545fa-a569-40ff-9308-2d550f545bf1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161322 Nov 10 16:09:39.929247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 774/1509] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:40.946752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:40.947780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:40.954678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:40.955123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:40.955906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:40.956333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:41.104002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:41.112335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4c89eb86-3398-4b54-869e-4bde68facead tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169969 Nov 10 16:09:41.112904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 736/1510] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:40 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:42.134629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:42.135671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:42.146828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:42.147563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:42.148824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:42.149473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:42.290405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:42.298659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-65d3351d-6968-402e-90b3-d41450e6ed30 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170606 Nov 10 16:09:42.299942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 775/1511] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:43.318984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:43.319871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:43.327530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:43.327975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:43.328762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:43.329192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:43.464536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:43.476380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b806362-786b-4b8f-8d74-51323ecb9fb7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163014 Nov 10 16:09:43.477262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 737/1512] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:44.500982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:44.501574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:44.509833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:44.510343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:44.511158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:44.511595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:44.656432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:44.664763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-156e0eff-dbe8-4ed8-bdd7-4a12de430525 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169382 Nov 10 16:09:44.665344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 776/1513] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:45.281635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:09:45.282205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:09:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:09:45.686299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:45.687311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:45.697329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:45.697775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:45.698609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:45.699039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:45.837302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:45.848065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-119334f7-5c27-40be-95fc-707aeab0608b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167839 Nov 10 16:09:45.848856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 738/1514] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:45 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:46.871039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:46.871626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:46.878380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:46.878899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:46.879721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:46.880159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:47.029369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:47.037818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1a5e4109-8736-455e-ad92-c6f9fcce8f3d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170785 Nov 10 16:09:47.038464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 777/1515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:46 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:48.058396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:48.059070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:48.066120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:48.066649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:48.067472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:48.067937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:48.215767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:48.224485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9ca84f94-19b3-4627-8f5c-ebce443a9f8d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171090 Nov 10 16:09:48.225039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 739/1516] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:48 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:49.241962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:49.242962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:49.249882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:49.250369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:49.251175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:49.251611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:49.390014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:49.402435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a116ffb3-0444-49ac-9ce6-ac71a5476760 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163871 Nov 10 16:09:49.403223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 778/1517] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:50.425979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:50.426992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:50.435454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:50.435896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:50.436675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:50.437103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:50.595710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:50.607360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1dbc815f-4d5a-491a-ab6c-fc6cf5413d34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.186048 Nov 10 16:09:50.607920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 740/1518] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:50 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:51.629747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:51.630756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:51.639365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:51.639814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:51.640611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:51.641034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:51.783171 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:51.791475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ca94156-9e96-4932-9112-8d8592ba6bd3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168932 Nov 10 16:09:51.792062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 779/1519] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:52.811859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:52.812586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:52.820903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:52.821459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:52.822558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:52.823073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:52.953556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:52.961518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e20f578c-380a-41da-b830-78e6bbd458de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.154789 Nov 10 16:09:52.962057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 741/1520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:52 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:53.984537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:53.985157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:53.991718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:53.992178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:53.992957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:53.993397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:54.136839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:54.145800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d37f356d-472a-4a28-88b5-cddc785c1502 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165299 Nov 10 16:09:54.146420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 780/1521] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:55.165334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:55.166130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:55.173439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:55.173872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:55.174663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:55.175083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:55.321791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:55.330177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-51209a8e-f214-4593-8d74-459b692595c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170020 Nov 10 16:09:55.330744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 742/1522] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:56.352996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:56.353614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:56.360645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:56.361131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:56.361922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:56.362511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:56.501167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:56.513660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3d39a5ef-a937-4b09-adc9-948f40876b17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164250 Nov 10 16:09:56.514454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 781/1523] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:56 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:57.265140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:09:57.265333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:09:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:09:57.540462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:57.541062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:57.548611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:57.549082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:57.549848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:57.550304 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:57.695243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:57.704199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5e2e1bb6-c266-4ee3-9325-10d3fc143f96 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170299 Nov 10 16:09:57.704777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 743/1524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:09:58.726095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:09:58.726987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:09:58.737815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:58.738620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:58.739960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:09:58.740646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:09:59.146070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:09:59.154493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ff03712-26c2-4719-9ca5-66e35ba0466f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.434758 Nov 10 16:09:59.155073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 782/1525] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:09:58 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:00.175311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:00.176068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:00.185369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:00.185816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:00.186648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:00.187081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:00.322868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:00.332099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9a3e39e2-8332-475b-87e6-a585c6c6d599 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162473 Nov 10 16:10:00.333339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 744/1526] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:00 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:01.353209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:01.353822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:01.360777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:01.361367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:01.362070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:01.362860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:01.504397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:01.517700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-92b5d224-b3e8-48a4-8c87-c467f96f12fd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170470 Nov 10 16:10:01.518407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 783/1527] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:01 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:02.537521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:02.538116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:02.544949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:02.545417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:02.546195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:02.546642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:02.691825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:02.700022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2bdb28f2-d1c0-414b-a3ff-8701d112d69a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166075 Nov 10 16:10:02.700647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 745/1528] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:03.721394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:03.722633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:03.732759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:03.733514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:03.734941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:03.735563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:03.879477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:03.887697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa31100f-5fc4-4dfd-9935-e7c8e2e94df1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172655 Nov 10 16:10:03.888245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 784/1529] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:03 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:04.907469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:04.908173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:04.916999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:04.917602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:04.918641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:04.919243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:05.077677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:05.089432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-82e0202f-9439-471e-8de9-fd1c8f5ecea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.187046 Nov 10 16:10:05.090214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 746/1530] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:06.111080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:06.111717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:06.118573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:06.118970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:06.119734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:06.120195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:06.287512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:06.297149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5a327e14-3977-40e0-a80c-7a0fdf16ad15 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.192303 Nov 10 16:10:06.297729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 785/1531] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:07.320583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:07.321522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:07.331139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:07.331841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:07.333098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:07.333775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:07.477463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:07.485725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e21309e2-a584-4ea4-a6b2-3e9d4848afa0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171000 Nov 10 16:10:07.486359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 747/1532] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:07 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:08.507030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:08.507903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:08.517489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:08.517953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:08.518760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:08.519190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:08.662646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:08.670872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ae6d3852-5119-4854-830e-539447d62b9c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170045 Nov 10 16:10:08.671470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 786/1533] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:09.693395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:09.694143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:09.701550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:09.701994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:09.702837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:09.703278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:09.854473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:09.863313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fb931e7c-67ca-4c69-b927-d288e5ad7070 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174442 Nov 10 16:10:09.863924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 748/1534] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:09 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:09.933232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:10:09.933393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:10:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:10:10.884896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:10.885977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:10.897054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:10.897856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:10.899236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:10.899967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:11.048122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:11.059816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-751c7138-cdc6-4a63-bc1e-67983ae58794 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181065 Nov 10 16:10:11.060606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 787/1535] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:10 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:12.077945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:12.078602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:12.085144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:12.085588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:12.086396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:12.086826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:12.223209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:12.231667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d8305d8a-7bde-480f-a15c-e2f8d4e34a86 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.157578 Nov 10 16:10:12.232196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 749/1536] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:13.249180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:13.250030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:13.256354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:13.256803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:13.257584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:13.258015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:13.401680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:13.415126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ec68c8b-f2a5-4cc2-aa6d-d0bc3b90baff tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169550 Nov 10 16:10:13.415883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 788/1537] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:13 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:14.434092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:14.434715 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:14.441419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:14.441864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:14.442688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:14.443113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:14.586509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:14.595308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c03ec51e-6089-4fe6-89c0-008228bdb593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165152 Nov 10 16:10:14.595877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 750/1538] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:15.613992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:15.614694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:15.625386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:15.626004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:15.627180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:15.627815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:15.768328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:15.776674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9924a9cc-f01c-4d27-a50a-e2622a1f7662 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166547 Nov 10 16:10:15.777235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 789/1539] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:15 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:16.792970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:16.793978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:16.804595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:16.805228 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:16.806574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:16.807202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:16.957344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:16.969298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c74ea6b8-2b2f-4f03-a104-f9e07e82f7e2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180163 Nov 10 16:10:16.969887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 751/1540] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:16 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:17.854456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:17.855012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:17.862125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:17.862601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:17.863393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:17.863828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:17.898566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:10:17.987066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-64237da8-a640-4b59-91ad-791fb6be6b27 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 204 len: 0 microversion: 2.20 time: 0.136050 Nov 10 16:10:17.987328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:17.988225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:17.988445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 790/1541] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Nov 10 16:10:17 2021] DELETE /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 10 16:10:17.995401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:17.995829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:17.996646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:17.997073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:17.997462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:17.998150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:18.004128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:18.004570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:18.005342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:18.005772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:18.192133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:18.195828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:18.200520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1b76ab2d-85dd-40da-b4b9-4415f625669e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.217612 Nov 10 16:10:18.201127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 752/1542] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:18.204702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:18.206230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:18.207470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8e726858-8d5b-4e05-8eda-cf39d1a46b12 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1723 microversion: 2.20 time: 0.214226 Nov 10 16:10:18.208016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 791/1543] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:10:17 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:10:19.217396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:19.217997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:19.226107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:19.226714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:19.226837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:19.226963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:19.227629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:19.228047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:19.241591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:19.242451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:19.243413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:19.243985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:19.336269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:19.346624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:19.348336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f70acf2d84d44c896f1d284b84fa9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b05ad418584ca19686c99ea57da374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:19.349569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9908bb8b-7e1b-4bad-b550-e7ea4dfba218 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 200 len: 1655 microversion: 2.20 time: 0.127250 Nov 10 16:10:19.350550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 792/1544] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:10:19 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 1655 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 10 16:10:19.486000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:19.515617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-45004596-3927-4376-bd4f-b3fd157a38a4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.301872 Nov 10 16:10:19.518151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 753/1545] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:19 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:19.558664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-8b376818-7645-445c-8f1d-d397b51be023 req-a464b7ab-2b7f-4344-8a52-abbce69f046f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5862436c-b538-451b-8764-b38c847b6a22", "name": "network-vif-deleted", "tag": "5e7491ee-768e-4525-9b7d-ec8192c5a901"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:10:19.560539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:10:19.560539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:10:19.568918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-8b376818-7645-445c-8f1d-d397b51be023 req-a464b7ab-2b7f-4344-8a52-abbce69f046f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:19.569603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-8b376818-7645-445c-8f1d-d397b51be023 req-a464b7ab-2b7f-4344-8a52-abbce69f046f service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:19.583094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-8b376818-7645-445c-8f1d-d397b51be023 req-a464b7ab-2b7f-4344-8a52-abbce69f046f service nova] Creating event network-vif-deleted:5e7491ee-768e-4525-9b7d-ec8192c5a901 for instance 5862436c-b538-451b-8764-b38c847b6a22 on hv-cinder-81708 Nov 10 16:10:19.589427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-8b376818-7645-445c-8f1d-d397b51be023 req-a464b7ab-2b7f-4344-8a52-abbce69f046f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144085 Nov 10 16:10:19.595189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 793/1546] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:10:20.369105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:20.370796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:20.377921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:20.378723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:20.379700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:20.380570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:20.396847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. Nov 10 16:10:20.397456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:10:20.398535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f36dc2a2-8d00-47cd-aa03-4ee2b1f6e580 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 404 len: 111 microversion: 2.20 time: 0.033166 Nov 10 16:10:20.399618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 754/1547] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Nov 10 16:10:20 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 10 16:10:20.409346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c6b4a22d-9883-4364-bc88-038ba73d93d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '.version_select at 0x7faa9b5edb80>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:20.433897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c6b4a22d-9883-4364-bc88-038ba73d93d7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158806762" status: 204 len: 0 microversion: 2.20 time: 0.029298 Nov 10 16:10:20.437773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 794/1548] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Nov 10 16:10:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158806762 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 10 16:10:20.535415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:20.535924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:20.542378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:20.542980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:20.543965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:20.544562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:20.730063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:20.743947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-940ce7f5-a8f6-4e87-ab81-81c1643827dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.212763 Nov 10 16:10:20.750065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 755/1549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:21.762650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:21.763363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:21.771119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:21.771805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:21.772614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:21.773024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:21.909744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:21.917562 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-04d0cc73-95c5-4145-8eb1-e6170a456f05 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159251 Nov 10 16:10:21.918136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 795/1550] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:21.951928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-536537571", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "networks": [{"uuid": "dcfba35b-5a66-47f5-96dc-9f6b79831f53"}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:10:22.006926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] validate_networks() for [('dcfba35b-5a66-47f5-96dc-9f6b79831f53', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:10:22.457134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:10:22.457810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:10:22.458545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:10:22.459201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:10:22.459797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:10:22.473743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:22.474307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:22.475471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:22.476079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:22.495596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:10:22.499754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Getting quotas for user d50d9103fa7d4f74bd77defac782f225 and project e776c427146842c1ba9637dc29f7281e. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:10:22.511177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:10:22.513471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:10:22.561387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-054614b8-7eda-4596-824d-fa586d6a9d92 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613030 Nov 10 16:10:22.566201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 756/1551] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:10:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:10:22.572024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-936f3450-53a3-4b6b-baa7-e762566e2c85 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:22.572652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-936f3450-53a3-4b6b-baa7-e762566e2c85 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:22.626532 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-936f3450-53a3-4b6b-baa7-e762566e2c85 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:22.633093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-936f3450-53a3-4b6b-baa7-e762566e2c85 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1217 microversion: 2.1 time: 0.064787 Nov 10 16:10:22.633650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 796/1552] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:22 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:22.935321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:22.936086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:22.943190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:22.943640 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:22.944418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:22.944847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:23.088394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:23.096826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-011d550d-6456-4573-b172-9a824ffc13f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165493 Nov 10 16:10:23.097390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 757/1553] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:23.651174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:23.652344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:23.659733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:23.660243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:23.660989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:23.661427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:23.757124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:23.765423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eb0a1650-22b8-450d-9b36-4d771bc5f2d7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1287 microversion: 2.1 time: 0.119107 Nov 10 16:10:23.766243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 797/1554] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:23 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:24.114907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:24.115494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:24.122638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:24.123387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:24.124261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:24.125009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:24.343504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:24.352055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0558f090-058d-43fc-9007-2387de091d54 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.241026 Nov 10 16:10:24.362074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 758/1555] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:24.783773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:24.784805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:24.792044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:24.792915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:24.793847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:24.794404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:24.990736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-f1a4e970-cc91-4441-bd35-50704cf68ff5 req-b855f55a-8ee7-403c-b176-1d928466406a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c27986-b00f-4524-8967-574b878088e8", "tag": "682b1429-4a27-44a5-835e-1102c9ec680f"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:10:24.992830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:10:24.992830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:10:25.009843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-f1a4e970-cc91-4441-bd35-50704cf68ff5 req-b855f55a-8ee7-403c-b176-1d928466406a service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:25.010972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-f1a4e970-cc91-4441-bd35-50704cf68ff5 req-b855f55a-8ee7-403c-b176-1d928466406a service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:25.024693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-f1a4e970-cc91-4441-bd35-50704cf68ff5 req-b855f55a-8ee7-403c-b176-1d928466406a service nova] Creating event network-changed:682b1429-4a27-44a5-835e-1102c9ec680f for instance b7c27986-b00f-4524-8967-574b878088e8 on hv-cinder-81708 Nov 10 16:10:25.031334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-f1a4e970-cc91-4441-bd35-50704cf68ff5 req-b855f55a-8ee7-403c-b176-1d928466406a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045554 Nov 10 16:10:25.032283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 759/1556] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:10:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:10:25.037556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:25.044994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4c1b18b6-7eca-45b6-8d78-2e929ec1c670 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.265587 Nov 10 16:10:25.045727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 798/1557] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:24 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:10:25.371030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:25.371709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:25.378946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:25.379383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:25.380194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:25.380629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:25.660766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:25.669022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fa59ebac-0cf7-4c9a-9415-430c846d3641 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.302595 Nov 10 16:10:25.669589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 760/1558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:26.062671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:26.063430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:26.069737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:26.070195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:26.070991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:26.071421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:26.219683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:26.227912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-091baa8a-38f6-4d24-8bde-8baddee25b0b tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.169298 Nov 10 16:10:26.228400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 799/1559] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:26 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:26.686434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:26.686996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:26.693925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:26.694396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:26.695162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:26.695591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:26.838147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:26.846487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-01dba08d-96a1-495d-a886-acc94455ad74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163793 Nov 10 16:10:26.847020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 761/1560] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:26 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:27.245225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:27.245873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:27.253601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:27.254053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:27.254859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:27.255289 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:27.392512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:27.400252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-db2ad86d-7d97-4b5a-a336-d545477a7736 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.158942 Nov 10 16:10:27.400829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 800/1561] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:27 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:27.864360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:27.864827 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:27.871194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:27.871635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:27.872400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:27.872861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:28.008103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:28.016281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-298ed26e-bde0-4174-8a2c-67307981a861 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.156192 Nov 10 16:10:28.016821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 762/1562] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:28.420921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:28.421979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:28.429455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:28.429953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:28.430816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:28.431268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:28.578051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:28.586265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8d4c4d0a-8c88-4011-acf7-f38fda6aa1c5 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.171668 Nov 10 16:10:28.586855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 801/1563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:28 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:29.033913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:29.034536 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:29.041288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:29.041670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:29.042719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:29.043148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:29.187505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:29.196890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2f7aae74-5847-4d1a-b271-98afd9cb13a5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167572 Nov 10 16:10:29.197483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 763/1564] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:29.603860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:29.604486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:29.611615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:29.612427 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:29.612869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:29.613300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:29.762172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:29.770598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9b2d6aa4-9817-4bfe-aaa7-802e7e986859 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.170785 Nov 10 16:10:29.771222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 802/1565] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:29 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:30.216057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:30.216667 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:30.223887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:30.224334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:30.225131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:30.225560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:30.365660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:30.373765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ee13a73a-625e-4697-a74b-079f5a5e326d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161984 Nov 10 16:10:30.374356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 764/1566] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:30.791488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:30.792104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:30.799057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:30.799516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:30.800297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:30.800728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:30.937535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:30.945630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6a557594-bd66-4d91-b01c-6c6ffac62608 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.157840 Nov 10 16:10:30.946207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 803/1567] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:30 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:31.393164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:31.393755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:31.400883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:31.401319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:31.402083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:31.402537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:31.543052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:31.551150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e8b333c4-7f4e-4f28-a890-3ef002ff3cc6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162335 Nov 10 16:10:31.552128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 765/1568] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:31.672395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-a5f81d79-8f8c-42bb-ac0e-9cf0f17d171f req-f04197ba-5306-4f8a-ad8e-c1b7c25cd926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c27986-b00f-4524-8967-574b878088e8", "name": "network-vif-plugged", "status": "completed", "tag": "682b1429-4a27-44a5-835e-1102c9ec680f"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:10:31.674672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:10:31.674672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:10:31.682175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a5f81d79-8f8c-42bb-ac0e-9cf0f17d171f req-f04197ba-5306-4f8a-ad8e-c1b7c25cd926 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:31.682636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a5f81d79-8f8c-42bb-ac0e-9cf0f17d171f req-f04197ba-5306-4f8a-ad8e-c1b7c25cd926 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:31.694441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-a5f81d79-8f8c-42bb-ac0e-9cf0f17d171f req-f04197ba-5306-4f8a-ad8e-c1b7c25cd926 service nova] Creating event network-vif-plugged:682b1429-4a27-44a5-835e-1102c9ec680f for instance b7c27986-b00f-4524-8967-574b878088e8 on hv-cinder-81708 Nov 10 16:10:31.700684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-a5f81d79-8f8c-42bb-ac0e-9cf0f17d171f req-f04197ba-5306-4f8a-ad8e-c1b7c25cd926 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085131 Nov 10 16:10:31.701558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 804/1569] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:10:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:10:31.962242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:31.962863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:31.969482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:31.969964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:31.970763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:31.971188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:32.113320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:32.120846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-08eff1dd-a219-4370-88ad-2d21f2217cd2 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1317 microversion: 2.1 time: 0.162370 Nov 10 16:10:32.121391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 766/1570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:31 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:32.573969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:32.575238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:32.586536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:32.587347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:32.588636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:32.589357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:32.732979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:32.746601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6ce112cf-dd1d-4b84-a5c2-e5d801d5a955 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179634 Nov 10 16:10:32.747374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 805/1571] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:33.139723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:33.140410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:33.148178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:33.148806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:33.149833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:33.150356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:33.286808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:33.294711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-028c6856-4845-4e82-9366-ed9e26c96d56 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1507 microversion: 2.1 time: 0.160845 Nov 10 16:10:33.295257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 767/1572] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:33 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:33.769709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:33.770336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:33.777286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:33.777714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:33.778554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:33.778982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:33.917253 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:33.925687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2c565c89-63ba-4fbd-8b4c-87da1f9bb642 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162867 Nov 10 16:10:33.926342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 806/1573] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:33 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:34.946080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:34.946721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:34.955135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:34.955723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:34.956686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:34.957302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:35.103450 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:35.115780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-291d1885-71c1-4b43-84f1-19529c997996 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174605 Nov 10 16:10:35.116338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 768/1574] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:34 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:36.137189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:36.137794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:36.144926 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:36.145465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:36.146276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:36.146703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:36.299600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:36.307690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0afd91c5-ab53-4ea0-98b3-e6eca4b8a470 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174407 Nov 10 16:10:36.308302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 807/1575] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:37.327935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:37.328591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:37.338814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:37.339369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:37.340428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:37.340940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:37.476132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:37.484878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-282e3a9c-009c-4848-bdf8-6c67fbdbfb23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162844 Nov 10 16:10:37.485404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 769/1576] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:38.502021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:38.502624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:38.509462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:38.509909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:38.510726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:38.511160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:38.651402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:38.662055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-753e62a6-24ed-40bb-9cdb-cc2a5e32998e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163402 Nov 10 16:10:38.662813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 808/1577] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:39.689826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:39.691167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:39.699371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:39.699816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:39.700595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:39.701045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:39.839473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:39.848984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3c25fdf3-2341-4f12-b86f-c049c6b4bddf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165729 Nov 10 16:10:39.849571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 770/1578] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:40.868983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:40.869596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:40.877577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:40.878099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:40.879034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:40.879536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:41.023326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:41.035564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2466349-da77-46ae-8114-af60097922cb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172018 Nov 10 16:10:41.036335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 809/1579] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:40 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:42.053562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:42.054317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:42.061145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:42.061589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:42.062414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:42.062844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:42.215223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:42.223361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-979b27e0-07f8-4dfc-a0d7-8ee2335227af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173553 Nov 10 16:10:42.223999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 771/1580] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:43.240152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:43.240832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:43.247975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:43.248426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:43.249254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:43.249664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:43.387995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:43.396352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-57e57147-6e15-48f7-9cc8-5e798667b1f6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160136 Nov 10 16:10:43.396897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 810/1581] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:44.417626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:44.418865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:44.430031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:44.430506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:44.431259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:44.431782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:44.576078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:44.584323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bbfd097d-a7d7-4c7c-ab53-7e02a72d4e42 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173159 Nov 10 16:10:44.584881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 772/1582] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:45.605072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:45.605684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:45.612851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:45.613323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:45.614181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:45.614656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:45.767856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:45.776056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-50d8d39d-52e8-47ff-a438-6e163a74a6c5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177072 Nov 10 16:10:45.776628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 811/1583] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:45 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:46.798352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:46.799006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:46.805861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:46.806328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:46.807091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:46.807511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:46.946538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:46.954706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9cfa1a50-a941-4b9b-8fa4-e297351b5149 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160214 Nov 10 16:10:46.955257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 773/1584] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:46 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:47.977109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:47.977697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:47.985600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:47.986053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:47.986899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:47.987356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:48.127769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:48.136693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b85c0fe6-804e-41f2-82a1-975ad5bd1027 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163218 Nov 10 16:10:48.137259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 812/1585] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:47 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:49.158230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:49.159191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:49.169217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:49.169628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:49.170469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:49.170888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:49.315879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:49.324506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-28cb41d1-5fd0-424c-8a04-ff8ddd786b56 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172522 Nov 10 16:10:49.325065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 774/1586] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:50.344956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:50.345654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:50.354349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:50.354956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:50.355996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:50.356629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:50.505490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:50.514014 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-521f30d2-cbe5-4d38-aa44-ea0aea29f2e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174681 Nov 10 16:10:50.514573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 813/1587] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:50 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:51.532239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:51.532865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:51.539427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:51.539874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:51.540793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:51.541229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:51.686199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:51.694898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6831151d-51f1-49be-933d-0bf8df09452a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166960 Nov 10 16:10:51.695462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 775/1588] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:52.712638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:52.713234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:52.720017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:52.720441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:52.721218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:52.721682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:52.862631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:52.870703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-569568b2-978d-4b7d-9207-ef966b30f189 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161833 Nov 10 16:10:52.871410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 814/1589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:52 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:53.893071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:53.893918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:53.905410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:53.906210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:53.907593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:53.908028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:54.047192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:54.060427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eb46b9b5-e10a-4892-bbda-61beda8b946e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174300 Nov 10 16:10:54.061169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 776/1590] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:55.081379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:55.082027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:55.089154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:55.089603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:55.090433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:55.090866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:55.238348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:55.247105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-513060c1-d2fb-42e8-b497-79b899610f62 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170965 Nov 10 16:10:55.247416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 815/1591] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:56.265051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:56.265584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:56.273147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:56.273587 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:56.274411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:56.274835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:56.420990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:56.429305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a95b2c18-febb-4b13-bbbd-d68b5e320b67 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168051 Nov 10 16:10:56.429960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 777/1592] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:56 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:57.446587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:57.447248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:57.454201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:57.455665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:57.455665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:57.455979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:57.589453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:57.598372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ced0a9a4-4beb-4b00-9e77-6a8d4731a1af tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.155597 Nov 10 16:10:57.598962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 816/1593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:58.617194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:58.617744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:58.624658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:58.625098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:58.626068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:58.626526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:58.782890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:58.794411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f3a6d28-c28d-4dc9-b453-159b9397556a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180923 Nov 10 16:10:58.795099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 778/1594] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:58 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:10:59.816150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:10:59.817342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:10:59.824091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:59.824554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:59.825382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:10:59.825819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:10:59.966347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:10:59.974969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-70f890da-19b5-4930-97ea-103856ebdee0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165180 Nov 10 16:10:59.975533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 817/1595] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:10:59 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:11:00.993093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:00.993689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:01.000236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:01.000660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:01.001437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:01.001860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:01.137405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:01.148824 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-df793cb2-c76d-4c21-9530-ee95b61d66d0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159313 Nov 10 16:11:01.149395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 779/1596] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:00 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:02.166893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:02.167563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:02.175129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:02.175624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:02.176489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:02.177070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:02.321135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:02.332073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-49eea8c0-2f56-4d9f-9287-9d30974e77b1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169333 Nov 10 16:11:02.332647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 818/1597] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:03.351568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:03.352280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:03.360685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:03.361176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:03.362084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:03.362631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:03.501198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:03.510447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bb10a428-7d2d-40e2-883e-9cdf29974cae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164105 Nov 10 16:11:03.511044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 780/1598] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:03 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:04.531179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:04.531836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:04.539556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:04.540069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:04.540927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:04.541422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:04.687471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:04.695469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7e7b7221-21f9-458c-b05f-400c97ebd1c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168648 Nov 10 16:11:04.696040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 819/1599] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:05.713009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:05.713651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:05.720082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:05.720516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:05.721278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:05.721670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:05.858061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:05.868713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0da28ae0-cc30-49e8-90a9-70e7949486e9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159842 Nov 10 16:11:05.869716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 781/1600] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:05 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:06.902607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:06.903197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:06.911690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:06.912226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:06.913276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:06.913720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:07.049885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:07.058183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4051a1a1-e751-40df-97ab-aaf5bc5d963d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160424 Nov 10 16:11:07.058772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 820/1601] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:08.075849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:08.076633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:08.083389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:08.083832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:08.084602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:08.085030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:08.232662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:08.241299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2d8c476a-1672-4c6b-b49d-abb0a7b1703d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169246 Nov 10 16:11:08.241990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 782/1602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:09.260826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:09.261448 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:09.268840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:09.269296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:09.270087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:09.270565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:09.407340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:09.415604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7811e3c2-bb69-48ad-a4af-22b9b58e602d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160290 Nov 10 16:11:09.416175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 821/1603] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:09 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:10.437101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:10.437868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:10.446893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:10.447459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:10.448394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:10.448926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:10.596055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:10.604349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f1bed3d4-b6ee-4545-bd95-69e4ad90009e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173845 Nov 10 16:11:10.604891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 783/1604] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:10 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:11.620705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:11.621295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:11.627774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:11.628218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:11.628993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:11.629414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:11.772762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:11.781539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-68ab93b3-fa1e-4b0f-bdaf-44ba31801de6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164526 Nov 10 16:11:11.782116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 822/1605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:11 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:12.807678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:12.808634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:12.818365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:12.819030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:12.820188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:12.820838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:12.967623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:12.979984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f1fb6abe-6847-47e0-b0f1-27d69524a807 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175030 Nov 10 16:11:12.980590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 784/1606] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:14.005237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:14.005850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:14.012867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:14.013320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:14.014103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:14.014573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:14.159842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:14.168406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ed66d4e9-20c3-4718-9bc0-5b95c8c94684 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166865 Nov 10 16:11:14.168993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 823/1607] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:15.257891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:15.258571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:15.265065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:15.265530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:15.266666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:15.267100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:15.401404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:15.409853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4130a6d0-126a-4a9a-abf9-e632c1f42013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.226530 Nov 10 16:11:15.410459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 785/1608] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:15 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:16.430829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:16.432022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:16.439212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:16.439667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:16.440447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:16.440884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:16.576880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:16.584783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-90e4ec9e-da4d-4588-ba0f-7abcdb0ec306 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160621 Nov 10 16:11:16.585349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 824/1609] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:16 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:17.602098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:17.602754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:17.609479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:17.609998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:17.610708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:17.611152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:17.741284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:17.749164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9195302-cc04-4572-bffa-55eba59bc249 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.150713 Nov 10 16:11:17.749735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 786/1610] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:18.770778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:18.771828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:18.782654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:18.783404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:18.784734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:18.785451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:18.932521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:18.940775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0f6f1277-f60c-4b4f-b683-eb4c9ac76a25 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176639 Nov 10 16:11:18.941376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 825/1611] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:18 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:19.962373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:19.963497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:19.970264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:19.970703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:19.971469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:19.971887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:20.108618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:20.116610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fca26236-2830-4e82-b1fe-21279ab25f29 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160598 Nov 10 16:11:20.117148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 787/1612] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:19 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:21.142509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:21.143303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:21.157088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:21.157691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:21.158830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:21.159412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:21.299745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:21.308050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-21045d06-7aa8-4b3b-8c2f-b9b5acc4b0d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171482 Nov 10 16:11:21.308621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 826/1613] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:22.333275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:22.334195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:22.343426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:22.343925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:22.345070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:22.345556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:22.494084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:22.502435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b5674115-0fa2-4247-9ea6-cee689da22d6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175575 Nov 10 16:11:22.503004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 788/1614] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:23.527656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:23.528741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:23.539960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:23.540714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:23.542327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:23.542841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:23.680461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:23.689310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-20ac4134-8151-4f05-bdaf-934e4bc28865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169017 Nov 10 16:11:23.689898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 827/1615] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:23 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:24.710678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:24.711701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:24.719455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:24.719899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:24.720674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:24.721103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:24.864055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:24.877405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8fd8a4b9-6a5a-44b8-b94e-503acc813d3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172391 Nov 10 16:11:24.878325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 789/1616] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:25.902040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:25.902724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:25.909714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:25.910192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:25.911104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:25.911586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:26.049754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:26.058537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4f69e729-731f-4f17-bb9a-84738aef5d99 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162983 Nov 10 16:11:26.059540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 828/1617] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:27.079804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:27.080393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:27.087107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:27.087652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:27.088308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:27.088760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:27.228086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:27.236096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b4b9651f-d1ed-4c25-b79b-dbede2aeed2a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160804 Nov 10 16:11:27.236652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 790/1618] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:28.256413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:28.257755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:28.274179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:28.274898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:28.276204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:28.276726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:28.419082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:28.427190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-472c7a85-3581-4160-beee-60df71897853 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177171 Nov 10 16:11:28.427741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 829/1619] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:28 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:29.448788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:29.449313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:29.456104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:29.456567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:29.457353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:29.457780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:29.589299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:29.597347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96ea76ff-642c-44a8-afa5-9064ab9da875 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.155018 Nov 10 16:11:29.597954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 791/1620] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:30.614812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:30.615440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:30.622766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:30.623221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:30.624010 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:30.624442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:30.774975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:30.788098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7c2f0a4f-3414-42b8-b938-e54945024368 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176669 Nov 10 16:11:30.788997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 830/1621] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:31.807774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:31.808455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:31.815935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:31.816352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:31.817199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:31.817666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:31.970939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:31.979121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aa247d7d-efe5-4bb7-9c93-6866809029c1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175558 Nov 10 16:11:31.979692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 792/1622] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:32.998731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:32.999383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:33.006011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:33.006465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:33.007245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:33.007685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:33.146483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:33.158979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-09665c11-f173-40b5-bd1c-e46fac01496a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164998 Nov 10 16:11:33.159803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 831/1623] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:34.180883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:34.181499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:34.188544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:34.188979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:34.189739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:34.190185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:34.330627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:34.338627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4ccfc6e4-dd18-4a75-85db-64a8c40a23dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161472 Nov 10 16:11:34.339183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 793/1624] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:34 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:35.357692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:35.358247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:35.365161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:35.365614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:35.366436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:35.366875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:35.510601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:35.519140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-57364ad5-1ebe-41cc-baa4-3b59a8956abd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165745 Nov 10 16:11:35.519719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 832/1625] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:35 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:36.539779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:36.540350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:36.549674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:36.550149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:36.551317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:36.551886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:36.692811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:36.702671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e8d2cb6-7470-4e50-93b8-3c2446a6fa74 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168467 Nov 10 16:11:36.703234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 794/1626] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:37.719930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:37.720516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:37.727393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:37.727846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:37.728628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:37.729061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:37.866812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:37.879517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32235d8c-9a12-43d7-8e7d-1bf73cf3779f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163349 Nov 10 16:11:37.880100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 833/1627] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:38.901503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:38.902499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:38.909675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:38.910122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:38.910961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:38.911363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:39.045299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:39.053697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d63bcccc-e28a-4d89-a67d-534bdbf83d0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.158437 Nov 10 16:11:39.054311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 795/1628] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:40.080024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:40.081043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:40.092394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:40.092877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:40.093727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:40.094167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:40.240697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:40.249471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-17b70330-22cc-4d59-80d2-217a15179882 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175620 Nov 10 16:11:40.249986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 834/1629] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:40 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:41.267404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:41.268004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:41.274904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:41.275346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:41.276113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:41.276537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:41.420534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:41.428611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ba29ab3f-4d81-4e7d-83e9-f57ac42c8193 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165550 Nov 10 16:11:41.429273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 796/1630] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:41 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:42.445940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:42.446626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:42.453412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:42.453858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:42.454665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:42.455088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:42.593421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:42.605771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7647f715-7ead-4dc3-9768-2dc7e4232a18 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163250 Nov 10 16:11:42.606575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 835/1631] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:43.627113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:43.627740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:43.634589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:43.635034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:43.635805 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:43.636237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:43.786573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:43.795465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-66d7259f-9cc4-49f9-a276-b434f8a5985c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174500 Nov 10 16:11:43.796220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 797/1632] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:44.813572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:44.814194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:44.821794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:44.822402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:44.823219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:44.823690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:44.967821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:44.977535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3d59bf1a-46c8-4fbb-9927-36626b880551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168155 Nov 10 16:11:44.978109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 836/1633] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:46.002041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:46.003215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:46.013724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:46.014526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:46.016144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:46.016851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:46.164387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:46.172315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56c510bb-32d5-4d23-a4d3-5b6677ef47da tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176361 Nov 10 16:11:46.172879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 798/1634] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:45 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:47.189184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:47.189810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:47.197104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:47.197583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:47.198404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:47.198835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:47.338547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:47.346972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-711f6775-a572-4667-9c9f-4e2a25d6c32f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161778 Nov 10 16:11:47.347572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 837/1635] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:47 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:48.364549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:48.365151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:48.372143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:48.372589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:48.373367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:48.373792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:48.510807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:48.519882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9cf7eb90-5d3b-4baa-a877-f09116b4e2bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159189 Nov 10 16:11:48.520483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 799/1636] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:48 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:49.545571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:49.546549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:49.557200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:49.557932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:49.559265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:49.559973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:49.705404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:49.714461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bc7f992e-7e6a-4d24-b478-23a01b0483f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175058 Nov 10 16:11:49.715034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 838/1637] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:50.732985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:50.733666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:50.741645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:50.742090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:50.742884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:50.743336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:50.890929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:50.899057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-65864cfd-64e3-4bf6-979c-fe8c90118876 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170372 Nov 10 16:11:50.899610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 800/1638] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:50 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:50.921072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:11:50.921779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:11:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:11:51.916449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:51.917059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:51.923787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:51.924381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:51.925080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:51.925565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:52.078900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:52.087606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cf92ab55-62b8-4b83-8cc1-b882e089b621 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174885 Nov 10 16:11:52.088171 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 839/1639] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:53.109189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:53.110202 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:53.121419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:53.122210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:53.123486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:53.124182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:53.271227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:53.279119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-90693819-f4ed-4da8-97ee-7cdd7f59a7cf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176234 Nov 10 16:11:53.279688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 801/1640] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:54.297399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:54.297920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:54.306107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:54.307463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:54.307463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:54.307840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:54.458464 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:54.470511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f8066079-b496-49d0-bc1a-b9fea87c683f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176996 Nov 10 16:11:54.471107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 840/1641] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:54 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:55.494193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:55.494874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:55.502936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:55.503451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:55.504359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:55.504864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:55.655821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:55.664120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e029ebd9-a6ed-45e1-81ff-29895b01400a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174437 Nov 10 16:11:55.664757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 802/1642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:56.680727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:56.681459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:56.687896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:56.688342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:56.689119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:56.689549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:56.823461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:56.831709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6dfb855d-1bd1-4a48-b0bb-c5d8537f2f6f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.154802 Nov 10 16:11:56.832283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 841/1643] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:56 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:57.849079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:57.850047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:57.856117 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:57.856557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:57.857329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:57.857755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:57.996886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:58.004723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b3dc335d-525f-4803-8f41-7929361de2fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159416 Nov 10 16:11:58.005506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 803/1644] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:11:59.022535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:11:59.023127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:11:59.029880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:59.030365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:59.031167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:11:59.031578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:11:59.183076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:11:59.193976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5dbbb2fb-a293-4ca3-a4e2-db9f50cff0a2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175450 Nov 10 16:11:59.194587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 842/1645] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:11:59 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:00.215491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:00.216423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:00.227559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:00.228301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:00.229597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:00.230365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:00.370283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:00.379504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4162580f-715b-4d38-aae9-598c19832cdb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170623 Nov 10 16:12:00.380134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 804/1646] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:00 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:01.397468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:01.402497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:01.410587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:01.411105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:01.411945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:01.412378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:01.863307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:01.872749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f3708204-9f31-4c38-a373-8be237be1028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.479246 Nov 10 16:12:01.873417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 843/1647] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:01 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:02.892267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:02.893066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:02.901068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:02.901515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:02.902315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:02.902743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:03.042865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:03.050971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c03d0ffe-7b91-407c-a43a-6081af2fba23 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163764 Nov 10 16:12:03.051507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 805/1648] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:04.071645 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:04.072385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:04.079346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:04.079799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:04.080589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:04.081012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:04.221962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:04.229923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e2f11075-1537-4d64-a0f0-fc65cb922774 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164220 Nov 10 16:12:04.230552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 844/1649] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:05.247436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:05.247826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:05.254444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:05.254863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:05.255635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:05.256060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:05.388552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:05.397433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f3fe106b-e83f-44eb-a710-425c5aef59ae tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.154143 Nov 10 16:12:05.397968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 806/1650] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:05 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:06.416229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:06.416874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:06.426336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:06.426762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:06.427560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:06.427993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:06.567325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:06.578487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d41cd2ce-75d8-440f-9e7e-9ac5f15e0229 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167763 Nov 10 16:12:06.579096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 845/1651] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:07.596740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:07.597322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:07.606463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:07.607025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:07.607804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:07.608233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:07.755655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:07.763977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7dbf0c12-274c-4d83-9f2c-f3f9c0cd9a5e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171715 Nov 10 16:12:07.764540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 807/1652] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:07 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:08.780701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:08.781304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:08.787918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:08.788359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:08.789159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:08.789571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:08.924896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:08.937633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-950d1d43-da4b-4468-8f67-f27986b0c62a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160223 Nov 10 16:12:08.938456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 846/1653] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:09.955519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:09.956193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:09.963594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:09.964088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:09.964975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:09.965405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:10.110421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:10.118407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b2d65859-1960-4724-87a4-451603db28d3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167053 Nov 10 16:12:10.118968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 808/1654] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:09 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:11.138817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:11.139474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:11.148774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:11.149302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:11.150238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:11.150745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:11.288192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:11.297199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0ee00b32-b4f2-4a11-950e-4d80ff0774f4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163824 Nov 10 16:12:11.297775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 847/1655] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:11 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:12.314769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:12.315347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:12.322190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:12.322666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:12.323439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:12.324118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:12.463989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:12.476616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-75a7e65f-9bec-4fae-862d-0986cf282f9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165473 Nov 10 16:12:12.477346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 809/1656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:13.498650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:13.499512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:13.510350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:13.511077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:13.512061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:13.512500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:13.657281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:13.665829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8aad4002-8b65-4c83-86b1-30e5de8bdc17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173966 Nov 10 16:12:13.666625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 848/1657] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:13 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:14.683554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:14.684189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:14.690968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:14.691413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:14.692207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:14.692708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:14.837441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:14.849345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ef71387f-3f09-4257-94f1-cfbf28973ed1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169167 Nov 10 16:12:14.850071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 810/1658] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:15.867971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:15.868616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:15.875938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:15.876387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:15.877178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:15.877613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:16.033588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:16.046826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7425483b-50b0-42e5-92cb-ac5bf8829f75 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182303 Nov 10 16:12:16.047708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 849/1659] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:15 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:17.072703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:17.073770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:17.080804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:17.081242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:17.082020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:17.082496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:17.222577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:17.230962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e19eaf3c-9f29-4ff1-9018-d2c075e6558b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164839 Nov 10 16:12:17.231514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 811/1660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:18.248304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:18.248929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:18.255677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:18.256129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:18.256944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:18.257382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:18.396156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:18.404223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1536e9df-b4e2-4d41-8483-1aa0e9cbf755 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159832 Nov 10 16:12:18.404794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 850/1661] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:18 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:19.425384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:19.426437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:19.437518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:19.438300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:19.439577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:19.440327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:19.582248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:19.588278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-46aba802-49b8-46be-b6ae-8a1acd419823 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169037 Nov 10 16:12:19.589051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 812/1662] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:19 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:20.610471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:20.611458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:20.621841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:20.622361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:20.623168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:20.623615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:20.779482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:20.792073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7a1fe8d2-73ea-4b5d-a375-fe5d6f3cc497 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.189193 Nov 10 16:12:20.793204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 851/1663] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:21.810285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:21.810864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:21.817599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:21.818040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:21.818849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:21.819274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:21.957767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:21.966799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8dbaf313-da8c-43d3-9d9e-2bb3257af593 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160589 Nov 10 16:12:21.967380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 813/1664] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:22.988300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:22.989403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:23.000228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:23.000971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:23.002254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:23.003021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:23.160371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:23.168739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fe0b50d6-156f-46f5-8f70-2d62f01e3069 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.186552 Nov 10 16:12:23.169340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 852/1665] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:24.190142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:24.191110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:24.202012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:24.203163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:24.204435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:24.205197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:24.348715 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:24.357815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a27c2211-22ec-4361-b7a2-cd516468c92f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174037 Nov 10 16:12:24.358412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 814/1666] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:25.374915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:25.375641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:25.382151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:25.382641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:25.383405 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:25.383833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:25.524023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:25.532259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-73c06373-c1d4-4c99-8d67-dc98da3c761f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161019 Nov 10 16:12:25.532834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 853/1667] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:26.556737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:26.557593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:26.571060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:26.571470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:26.573798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:26.573798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:26.721971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:26.730610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-405d41ad-9632-4d91-b09d-763ad527294d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180309 Nov 10 16:12:26.731172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 815/1668] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:26 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:27.748180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:27.748791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:27.755442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:27.755951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:27.756797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:27.757293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:27.895367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:27.907203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0967e3e7-fc4b-4e64-aed8-b811d747e289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162451 Nov 10 16:12:27.907978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 854/1669] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:28.932436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:28.933417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:28.941486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:28.941930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:28.942753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:28.943183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:29.091402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:29.100438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bd17d53f-e14a-4f00-83d3-d110187df551 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174302 Nov 10 16:12:29.101022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 816/1670] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:28 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:30.121240 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:30.122032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:30.132345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:30.133038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:30.134230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:30.134950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:30.279036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:30.287700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c7f46e3e-fd2a-4a85-8797-90c0bce07f1f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172255 Nov 10 16:12:30.288271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 855/1671] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:31.308538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:31.309659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:31.317525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:31.317968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:31.318778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:31.319205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:31.475769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:31.484457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7658af06-4051-495a-aecc-ade541f77e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181880 Nov 10 16:12:31.485001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 817/1672] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:32.505584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:32.506535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:32.517169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:32.517611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:32.518449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:32.518890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:32.663887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:32.672685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5fd9fde-b866-4acd-8d85-df0759f7d348 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173733 Nov 10 16:12:32.673255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 856/1673] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:33.693872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:33.694497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:33.701792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:33.702265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:33.703302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:33.704539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:33.844514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:33.852572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f8f2b639-0d72-4c23-ae0d-49fc86f0b9f3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162504 Nov 10 16:12:33.853165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 818/1674] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:33 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:34.870860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:34.871820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:34.879530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:34.879983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:34.880799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:34.881236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:35.029142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:35.037796 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bccf8213-ef10-41d5-92af-6c452a1815d5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170696 Nov 10 16:12:35.038398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 857/1675] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:34 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:36.057611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:36.058221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:36.068440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:36.069032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:36.070243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:36.070850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:36.223204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:36.233601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cbb874ed-9bb4-4c5e-bffa-9a543c3e2e72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181331 Nov 10 16:12:36.234297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 819/1676] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:37.250856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:37.251486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:37.258149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:37.258621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:37.259388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:37.259820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:37.393834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:37.402597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-27967fda-cc35-4cbe-a354-6bf0c826c5f9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.155512 Nov 10 16:12:37.403176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 858/1677] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:38.423396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:38.423988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:38.430897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:38.431336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:38.432103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:38.432532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:38.584413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:38.596922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2be8d996-dcbf-429c-a72d-13a3f332d812 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179405 Nov 10 16:12:38.597491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 820/1678] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:39.618244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:39.619133 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:39.627977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:39.628425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:39.629201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:39.629628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:39.779401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:39.792182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-09731765-0f39-40b0-ae56-117699fc7e61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179904 Nov 10 16:12:39.793024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 859/1679] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:40.811698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:40.812823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:40.823329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:40.823897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:40.825148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:40.825767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:40.975875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:40.984675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8209d3a9-ca4f-4f37-87e3-8259ebe237c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179442 Nov 10 16:12:40.985175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 821/1680] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:40 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:42.006682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:42.007681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:42.018942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:42.019354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:42.020787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:42.021230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:42.173512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:42.182268 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-153f8ad6-db37-4260-a8da-a2d846c7db61 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182346 Nov 10 16:12:42.182867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 860/1681] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:41 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:43.203615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:43.204639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:43.215384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:43.216110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:43.217502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:43.218221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:43.363312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:43.371513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fdddfb7b-4e37-4d98-b3bc-875082e73619 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174051 Nov 10 16:12:43.371920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 822/1682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:44.388315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:44.388994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:44.396004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:44.396449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:44.397229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:44.398350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:44.540448 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:44.548633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-737fb5bd-5df3-4e2d-b5fa-41981d4c6d26 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164050 Nov 10 16:12:44.549217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 861/1683] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:45.567980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:45.568596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:45.575582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:45.576026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:45.576819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:45.577252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:45.713440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:45.721462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b9d3e8c5-f355-4b78-b195-8e152a1c9df5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.158525 Nov 10 16:12:45.722032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 823/1684] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:45 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:46.743500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:46.744644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:46.755523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:46.755894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:46.756659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:46.757085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:46.907758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:46.917251 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-644b4704-3370-41f2-9924-d6c460c552de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180204 Nov 10 16:12:46.917865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 862/1685] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:46 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:47.938405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:47.939321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:47.949825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:47.950617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:47.951896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:47.952733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:48.103975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:48.115898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8cb5211d-fe93-4367-9f5c-44d95887ddbf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.183743 Nov 10 16:12:48.116567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 824/1686] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:47 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:49.135247 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:49.135976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:49.144144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:49.144670 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:49.145625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:49.146399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:49.295032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:49.308170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-211c53da-2e2c-4fa8-a266-c96092ef1f50 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177050 Nov 10 16:12:49.309079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 863/1687] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:50.333471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:50.334312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:50.340896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:50.341340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:50.342102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:50.342588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:50.481145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:50.493241 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c772b085-728b-41a2-be75-03151b3c6455 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166224 Nov 10 16:12:50.494106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 825/1688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:50 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:51.511524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:51.512108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:51.519300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:51.519752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:51.520785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:51.521229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:51.657919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:51.669015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-43082b53-3fa0-4764-b27c-e12d408f0048 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161310 Nov 10 16:12:51.669766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 864/1689] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:52.691898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:52.692492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:52.703350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:52.703789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:52.704625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:52.705033 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:52.851142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:52.859419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-92ad5886-1d81-4109-895f-4eeed624cfb1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173624 Nov 10 16:12:52.860168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 826/1690] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:52 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:53.877188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:53.877839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:53.885147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:53.885647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:53.886520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:53.886979 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:54.025103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:54.033192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-741ac70f-6af1-46a6-835b-15639065aea5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160123 Nov 10 16:12:54.033756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 865/1691] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:55.051237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:55.051681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:55.060286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:55.060736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:55.062695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:55.062695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:55.202369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:55.214034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d549c5f8-ac13-4d11-80b0-4fa506dfeae9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166918 Nov 10 16:12:55.214882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 827/1692] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:56.240219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:56.241353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:56.249440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:56.250061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:56.251207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:56.251753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:56.400467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:56.413867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b7f36898-98fe-45d7-a0c7-af53828b85c4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.179826 Nov 10 16:12:56.414882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 866/1693] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:56 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:57.441994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:57.442978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:57.453005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:57.453741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:57.455076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:57.455796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:57.625370 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:57.633890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7d0e3a82-5c28-418c-a2d2-b7898569534f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.198636 Nov 10 16:12:57.634512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 828/1694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:58.654425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:58.655279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:58.663983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:58.664578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:58.666129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:58.666674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:58.821481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:12:58.830215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dd89d076-923a-4e9d-a25e-d4c49a4a3058 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181240 Nov 10 16:12:58.830840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 867/1695] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:58 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:12:59.847963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:12:59.848609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:12:59.855171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:59.855612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:12:59.856376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:12:59.856817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:00.006951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:00.015789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9bde25b-c4cf-4a67-8eea-6a11d048152e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171726 Nov 10 16:13:00.016354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 829/1696] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:12:59 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:01.036395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:01.037295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:01.047571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:01.048016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:01.048803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:01.049267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:01.193814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:01.202775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3651d29b-cdba-416b-b9fb-abb09102bdf7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172935 Nov 10 16:13:01.203277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 868/1697] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:01 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:02.222405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:02.223018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:02.229563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:02.229999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:02.230804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:02.231247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:02.393515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:02.401589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1d076f72-ac4e-45d4-ab0b-a6e945f3df7d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.183043 Nov 10 16:13:02.404113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 830/1698] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:03.419638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:03.419638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:03.426658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:03.427117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:03.427904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:03.428384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:03.572681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:03.584973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f2bf4e19-22cc-4af2-b9d4-ab97bf3d6274 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169663 Nov 10 16:13:03.585751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 869/1699] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:03 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:04.604780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:04.605391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:04.612239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:04.612687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:04.613474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:04.613908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:04.745004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:04.752741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f6307a84-4809-4ba3-af1c-5b1d308d7a55 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.151672 Nov 10 16:13:04.753396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 831/1700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:05.305769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:13:05.306028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:13:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:13:05.774864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:05.775374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:05.782881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:05.783330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:05.784116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:05.784550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:05.933054 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:05.941591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c222189f-1e4a-46a9-9e91-ac77217ad2a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170637 Nov 10 16:13:05.942199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 870/1701] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:05 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:06.959533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:06.960168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:06.969223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:06.969822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:06.970658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:06.971110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:07.122056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:07.133408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-efeaeb99-9197-44e1-a495-dd0559e9541c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177117 Nov 10 16:13:07.134469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 832/1702] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:08.156368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:08.156971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:08.164165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:08.164624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:08.165403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:08.165832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:08.304557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:08.313347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4b32c1e4-9263-4ae4-b765-24b7e8a5a64f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162844 Nov 10 16:13:08.313877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 871/1703] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:09.339610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:09.340578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:09.348787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:09.349227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:09.350003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:09.350461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:09.498696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:09.507952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-711e2eaa-23b2-4fbf-8c00-48daa8c3df0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174517 Nov 10 16:13:09.508453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 833/1704] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:09 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:10.527188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:10.527828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:10.535738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:10.536271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:10.537206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:10.537717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:10.694388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:10.702961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d535d0ab-18d8-437e-9e8c-b91029585d58 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180409 Nov 10 16:13:10.703515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 872/1705] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:10 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:11.728593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:11.729502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:11.740532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:11.741262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:11.742609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:11.743342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:11.903106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:11.912578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4c9924fd-680c-4d5f-ab63-3a4c4cf3afe4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.190517 Nov 10 16:13:11.913161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 834/1706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:11 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:12.928860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:12.929469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:12.936165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:12.936616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:12.937387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:12.937815 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:13.070713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:13.078701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbea624e-5359-43a7-b02f-1396f6e77550 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.153580 Nov 10 16:13:13.079385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 873/1707] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:14.096974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:14.097538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:14.105058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:14.105488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:14.106296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:14.106717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:14.253135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:14.262035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-31aa768e-2845-48f6-aaec-7b67cb474ab5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168947 Nov 10 16:13:14.262654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 835/1708] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:15.282978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:15.283512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:15.290357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:15.290808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:15.291597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:15.292033 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:15.433332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:15.444224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-827526ce-b4cb-4593-b4e5-7299caa238c0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167233 Nov 10 16:13:15.444799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 874/1709] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:15 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:16.465027 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:16.465901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:16.477050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:16.477781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:16.479150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:16.479869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:16.628005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:16.636634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a5678d9a-1b0e-492e-a443-1e5194382965 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.178188 Nov 10 16:13:16.637169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 836/1710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:16 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:17.284888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:13:17.285429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:13:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:13:17.657928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:17.658573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:17.665446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:17.665904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:17.666742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:17.667179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:17.806755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:17.815856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-742e2f40-5652-4464-ac7f-31572ba842ba tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163988 Nov 10 16:13:17.816437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 875/1711] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:18.837184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:18.838104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:18.847714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:18.848174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:18.848933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:18.849361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:18.995177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:19.003615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-037d850c-543a-449b-bda7-0410c908be19 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172541 Nov 10 16:13:19.004128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 837/1712] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:18 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:20.027015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:20.027737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:20.034548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:20.034984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:20.035767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:20.036212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:20.175535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:20.184020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-30dd6690-0170-4c99-94a4-2c827ef621f2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161237 Nov 10 16:13:20.184590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 876/1713] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:21.202897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:21.203533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:21.210473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:21.210913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:21.211706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:21.212136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:21.360958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:21.368809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fab99246-3eb4-43f2-a14e-d88cd805f1eb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169828 Nov 10 16:13:21.369368 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 838/1714] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:22.394876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:22.395535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:22.402474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:22.402915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:22.403684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:22.404108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:22.540828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:22.548914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e7d7c585-e174-456e-b9a8-f86326ffe028 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159459 Nov 10 16:13:22.549491 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 877/1715] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:23.565886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:23.566603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:23.573045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:23.573505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:23.574285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:23.575025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:23.607925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:13:23.608661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:13:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:13:23.710907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:23.724244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7f98db64-3f61-4b65-b7c6-8f822d6e1dcb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161736 Nov 10 16:13:23.725099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 839/1716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:23 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:24.748786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:24.749736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:24.757732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:24.757973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:24.758686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:24.759153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:24.916141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:24.929558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58d4a37a-f0ed-4fcb-aa1a-7034d7918200 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.186793 Nov 10 16:13:24.930357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 878/1717] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:25.954280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:25.955173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:25.961800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:25.962270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:25.963045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:25.963471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:26.112951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:26.125261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-788141fa-cb19-45a2-b496-f430824b0468 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177037 Nov 10 16:13:26.126024 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 840/1718] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:27.150529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:27.151573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:27.161430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:27.161875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:27.163921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:27.164345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:27.305511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:27.313904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0d15b610-03f3-4a11-a77a-6dfb8e2aa4ce tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169572 Nov 10 16:13:27.314594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 879/1719] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:27 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:28.333506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:28.334097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:28.340985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:28.341454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:28.342293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:28.342744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:28.489744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:28.498272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-25ddbf17-da40-4770-bb7f-23942b147d3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170052 Nov 10 16:13:28.498789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 841/1720] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:28 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:29.516101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:29.516682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:29.523667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:29.524116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:29.524891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:29.525325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:29.680442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:29.688565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-22de4a94-ace0-4da6-826a-6a70c6320e66 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177000 Nov 10 16:13:29.689152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 880/1721] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:29.951598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:13:29.952118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:13:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:13:30.716059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:30.716963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:30.726028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:30.726493 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:30.727261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:30.727686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:30.878706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:30.886888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-50de23bf-b1a7-410f-b73b-72472528edf5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177515 Nov 10 16:13:30.887447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 842/1722] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:31.909156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:31.910098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:31.918062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:31.918554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:31.919336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:31.919774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:32.068799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:32.076541 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dfbca6a8-431f-4ad4-936b-b8bd2240e611 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173545 Nov 10 16:13:32.077076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 881/1723] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:33.092860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:33.093470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:33.100148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:33.100608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:33.101461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:33.101905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:33.236358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:33.253437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2ffbe224-f9e3-4a5b-afb7-96f409015d2d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164156 Nov 10 16:13:33.254946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 843/1724] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:33 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:34.273068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:34.273679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:34.280267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:34.280717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:34.281494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:34.281928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:34.434711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:34.446763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9abbad0d-effa-45e9-acba-1f355c272d10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177174 Nov 10 16:13:34.447499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 882/1725] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:34 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:35.468009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:35.468812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:35.479957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:35.480406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:35.481212 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:35.481648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:35.627150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:35.637151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0fc0c29e-7500-461d-bdd8-6708c2763495 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175502 Nov 10 16:13:35.637754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 844/1726] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:35 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:36.657455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:36.658044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:36.665233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:36.665730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:36.666747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:36.667181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:36.802060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:36.810627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b296e519-4ef4-41ee-b40a-4997be11157c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.156878 Nov 10 16:13:36.811196 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 883/1727] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:37.829025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:37.829731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:37.837794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:37.838362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:37.839285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:37.839791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:37.997199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:38.005383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-279d8ce9-bb2e-4215-903a-21e3098649c2 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181001 Nov 10 16:13:38.006233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 845/1728] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:39.025897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:39.026615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:39.034399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:39.034858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:39.035648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:39.036084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:39.190061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:39.198863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2b9bfc32-1c7f-4fce-b5f9-652d2fead182 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.178439 Nov 10 16:13:39.199458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 884/1729] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:40.219309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:40.220302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:40.230370 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:40.230982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:40.232122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:40.232723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:40.381644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:40.392881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6fd35347-8fcf-4329-b500-5de35f24ae2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180218 Nov 10 16:13:40.393454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 846/1730] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:40 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:41.410296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:41.410946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:41.417615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:41.418082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:41.418882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:41.419327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:41.564920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:41.572905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b075fae7-2b61-412e-beb2-89388357eff4 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166436 Nov 10 16:13:41.573470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 885/1731] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:41 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:42.591728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:42.592487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:42.600804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:42.601348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:42.602327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:42.602861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:42.740724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:42.748630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e31e966e-c3ae-40c9-9a00-3eb91c7aa865 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161502 Nov 10 16:13:42.749492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 847/1732] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:43.765076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:43.765707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:43.772210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:43.772651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:43.773426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:43.773853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:43.907070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:43.915412 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f5c0690c-e591-43ad-a8da-446fdfe6ddfe tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.154363 Nov 10 16:13:43.915987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 886/1733] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:44.936902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:44.937861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:44.948666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:44.949404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:44.950854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:44.951929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:45.095576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:45.107643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-41879e97-80dd-451d-aa81-fc481e8880d1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176968 Nov 10 16:13:45.108491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 848/1734] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:46.134857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:46.135778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:46.145555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:46.145999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:46.146806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:46.147232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:46.296818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:46.305552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1717dab2-a85c-45f1-b680-5f2f11672962 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176988 Nov 10 16:13:46.306134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 887/1735] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:46 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:47.326889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:47.328004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:47.338380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:47.339112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:47.340386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:47.341096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:47.488249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:47.496556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5a5cb697-c0f7-40bf-b034-c0a553af17ed tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176044 Nov 10 16:13:47.497214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 849/1736] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:47 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:48.518271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:48.518889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:48.525810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:48.526325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:48.527110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:48.527542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:48.883784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:48.896877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-55966a7c-fe2d-46e8-82c2-2a45cfe53556 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.383764 Nov 10 16:13:48.897764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 888/1737] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:48 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:49.922460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:49.923160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:49.930146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:49.930618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:49.931392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:49.931817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:50.069517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:50.077484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5791acef-2dc0-4de0-bc65-d4cecd668c2b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161361 Nov 10 16:13:50.078341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 850/1738] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:51.103131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:51.103839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:51.110904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:51.111380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:51.112158 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:51.112583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:51.254898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:51.263350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-890929d3-3b52-4eef-934e-005c0dc8ef9b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163907 Nov 10 16:13:51.264285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 889/1739] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:52.280745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:52.281313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:52.288544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:52.288986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:52.289755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:52.290200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:52.435442 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:52.448240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4ad08e51-47a0-4936-81c0-c01694fe2f37 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170927 Nov 10 16:13:52.449210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 851/1740] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:52 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:53.470749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:53.471320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:53.479272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:53.479829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:53.480795 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:53.481419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:53.622068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:53.630132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1fba224f-b8c5-4f4b-adfe-68fa4183b223 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165659 Nov 10 16:13:53.630756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 890/1741] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:54.647626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:54.648348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:54.654939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:54.655373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:54.656134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:54.656553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:54.810617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:54.819636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3b7f67c-2d0d-4115-8e05-616fcbe79e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.175711 Nov 10 16:13:54.820200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 852/1742] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:54 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:55.837955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:55.838695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:55.846631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:55.847079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:55.847860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:55.848295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:55.995118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:56.004602 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee8ad5b1-fcc9-4271-9c23-fb4a34ff6c91 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171387 Nov 10 16:13:56.005176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 891/1743] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:57.023654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:57.024401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:57.032391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:57.032870 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:57.033812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:57.034449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:57.180730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:57.193698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1378368d-f491-45fe-af5c-b4cae27ecb0d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174365 Nov 10 16:13:57.194620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 853/1744] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:58.219190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:58.220170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:58.228246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:58.228761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:58.229572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:58.230005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:58.370215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:58.378794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8135eabf-e301-4dea-a8e7-fe95db2d72d8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165838 Nov 10 16:13:58.379496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 892/1745] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:58 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:13:59.399239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:13:59.399968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:13:59.408061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:59.408617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:59.409581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:13:59.410122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:13:59.568323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:13:59.576593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cafdcd73-12aa-4476-a2ad-6751afa8f91e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182967 Nov 10 16:13:59.577178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 854/1746] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:13:59 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:00.594103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:00.595128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:00.602482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:00.602950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:00.603752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:00.604172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:00.769651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:00.778502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b195af00-b827-4edd-ba88-27ece7b72e4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.188525 Nov 10 16:14:00.779290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 893/1747] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:00 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:01.800880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:01.801447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:01.810497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:01.810941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:01.811723 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:01.812158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:01.952293 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:01.960657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cde5c072-f4fa-494f-9db3-08ebbc13bc4f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163529 Nov 10 16:14:01.961245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 855/1748] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:01 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:02.978185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:02.978784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:02.986037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:02.986534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:02.987368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:02.987817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:03.166799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:03.178982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c53238d5-2b55-4e98-a1da-1dc6e7e4df4c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.204170 Nov 10 16:14:03.179569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 894/1749] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:04.197925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:04.199278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:04.208816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:04.209256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:04.210107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:04.210573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:04.350041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:04.362802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-93658100-d7a6-4f9a-8694-d26b98ac20dc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168881 Nov 10 16:14:04.363545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 856/1750] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:05.385949 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:05.387142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:05.398828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:05.399328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:05.400174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:05.400644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:05.548030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:05.564773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eb5c4580-8589-40bf-8b8a-4d875b77e151 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.185773 Nov 10 16:14:05.565577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 895/1751] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:05 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:06.587420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:06.588017 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:06.594745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:06.595196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:06.595996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:06.596425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:06.739696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:06.748598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bbedd19d-8e67-4dc8-b435-18e1a06c06b5 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165426 Nov 10 16:14:06.749191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 857/1752] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:07.770633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:07.771262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:07.780953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:07.781576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:07.782821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:07.783345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:07.941472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:07.950504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f34fbaa3-23e7-4e63-9387-5766ca4180bf tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.185848 Nov 10 16:14:07.951246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 896/1753] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:07 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:08.973050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:08.974019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:08.984577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:08.985347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:08.986683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:08.987410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:09.126699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:09.135084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b5730f76-6553-4f6e-9ae6-1f2d307f109c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168254 Nov 10 16:14:09.135676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 858/1754] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:10.152991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:10.153631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:10.169096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:10.169096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:10.169096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:10.169096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:10.294509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:10.306610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ffa043af-6489-4f29-b2f7-63887980e6fc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.157019 Nov 10 16:14:10.307129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 897/1755] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:10 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:11.327338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:11.328254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:11.338076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:11.338619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:11.339420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:11.339849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:11.499393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:11.507586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3836a07d-5ba9-40aa-8161-bc26bf09bf8c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.186612 Nov 10 16:14:11.508154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 859/1756] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:11 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:12.531967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:12.532742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:12.543498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:12.544319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:12.545474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:12.546061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:12.719918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:12.731630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4d10b57f-8fa5-41cd-bd1f-160a8b9d8944 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.204155 Nov 10 16:14:12.732617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 898/1757] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:13.757623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:13.758689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:13.766605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:13.767057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:13.767833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:13.768257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:13.910367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:13.918649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6c6dab02-c54c-4b87-86e7-c3feb5f9ba7b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167320 Nov 10 16:14:13.919188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 860/1758] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:13 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:14.940169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:14.941281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:14.952682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:14.953439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:14.954819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:14.955555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:15.117737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:15.126379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dccb8fe0-9022-41e7-a1f0-6e73a16f21bc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.192522 Nov 10 16:14:15.126956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 899/1759] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:16.148174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:16.149235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:16.160163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:16.160906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:16.162208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:16.162930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:16.302142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:16.311775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-84175af0-1580-44f6-b458-8fac52789dcc tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.170132 Nov 10 16:14:16.312343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 861/1760] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:16 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:17.331930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:17.332704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:17.340970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:17.341421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:17.342198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:17.342664 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:17.488568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:17.500936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-de3c9121-5a52-4415-862b-5b10bfa2f0aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173958 Nov 10 16:14:17.503139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 900/1761] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:18.523363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:18.524276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:18.531720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:18.532157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:18.532942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:18.533359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:18.670076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:18.678023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-48f57310-3d02-4977-a38f-9a416c058289 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161004 Nov 10 16:14:18.678657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 862/1762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:18 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:19.702484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:19.703121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:19.709465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:19.709915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:19.710734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:19.711157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:19.862833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:19.873705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-de7a19fc-ad9f-4f11-b940-0fc6482bb9a3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181813 Nov 10 16:14:19.874428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 901/1763] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:19 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:20.898731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:20.900018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:20.907760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:20.908184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:20.908955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:20.909374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:21.061266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:21.069665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f2bc6a3c-2ae7-42c5-8aaf-89eebd616dd9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177120 Nov 10 16:14:21.070250 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 863/1764] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:22.091225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:22.092179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:22.102909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:22.103669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:22.104769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:22.105200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:22.253619 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:22.266286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8a452e2c-2066-478d-9154-f3cee43d9b8f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.181295 Nov 10 16:14:22.267045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 902/1765] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:23.287317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:23.287940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:23.295045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:23.295492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:23.296318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:23.296751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:23.540074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:23.548811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b3290a08-18cd-4e1f-b887-6f8c342c88f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.265325 Nov 10 16:14:23.549395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 864/1766] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:23 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:24.567929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:24.568634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:24.576916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:24.577485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:24.578518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:24.579061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:24.762694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:24.771383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-56929e4d-3c27-47b5-8d2c-a0fbb695a408 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.208286 Nov 10 16:14:24.771980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 903/1767] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:24 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:25.789087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:25.789735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:25.796489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:25.796939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:25.797712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:25.798193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:25.947643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:25.956491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dcee702d-ab4f-4237-aac2-566db5c60e3b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171217 Nov 10 16:14:25.957068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 865/1768] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:25 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:26.978079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:26.981134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:26.994925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:26.995434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:26.996175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:26.996601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:27.137357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:27.145654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e9de6e5d-a362-486a-be6f-a74d55a09a3c tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174106 Nov 10 16:14:27.146509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 904/1769] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:26 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:28.163542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:28.164098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:28.170581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:28.171016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:28.171813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:28.172233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:28.304030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:28.312767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-512088fe-565b-4e1f-b59b-5ae0f1093a17 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.153319 Nov 10 16:14:28.313302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 866/1770] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:28 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:29.329824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:29.330476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:29.337504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:29.337956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:29.339058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:29.339458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:29.483719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:29.492435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-71352c92-7284-4652-a229-4f6775e9576e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166439 Nov 10 16:14:29.493021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 905/1771] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:29 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:30.514572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:30.515534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:30.526351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:30.527175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:30.527963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:30.528404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:30.676638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:30.685069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fc27945f-e232-406c-a11a-90e9d984e277 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177363 Nov 10 16:14:30.685633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 867/1772] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:30 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:31.705582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:31.706469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:31.716208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:31.716849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:31.717993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:31.718617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:31.870717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:31.882961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-de019a83-3678-4ae6-993c-8458985e17bd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.182874 Nov 10 16:14:31.883737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 906/1773] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:31 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:32.900425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:32.901062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:32.907947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:32.908383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:32.909139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:32.909560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:33.060020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:33.071719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8d91ed1e-123f-451d-92d7-73ea640ba4bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174913 Nov 10 16:14:33.072537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 868/1774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:32 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:34.089653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:34.090439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:34.097999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:34.098473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:34.099350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:34.099836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:34.241753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:34.250116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-588c1b51-5af6-4eae-8a4a-26818440ca3f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164655 Nov 10 16:14:34.250723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 907/1775] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:34 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:35.267921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:35.268529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:35.275395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:35.275840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:35.276617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:35.277054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:35.421635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:35.430346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-01e0d1a5-e4a3-43aa-8d42-611fa9d8347d tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166149 Nov 10 16:14:35.430916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 869/1776] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:35 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:36.449335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:36.449942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:36.456746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:36.457208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:36.457982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:36.458443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:36.599017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:36.607610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3e6fc289-eb12-4b63-ba57-8e49563e79a9 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163640 Nov 10 16:14:36.608192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 908/1777] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:36 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:37.628655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:37.629728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:37.639466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:37.639903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:37.640659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:37.641081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:37.779547 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:37.787528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c52b7e7a-c95f-46c3-8031-91c7fccace5b tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165097 Nov 10 16:14:37.788059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 870/1778] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:37 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:38.805087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:38.805750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:38.813454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:38.813903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:38.814757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:38.815200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:38.956623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:38.967146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6249ac4d-f695-47cd-81fe-e6b8b113b1bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.163624 Nov 10 16:14:38.967779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 909/1779] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:38 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:39.984958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:39.986197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:39.993260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:39.993709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:39.994545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:39.995005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:40.144113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:40.153215 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-000630c2-2785-4cb6-ba7a-525c580baaf0 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.171757 Nov 10 16:14:40.154191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 871/1780] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:39 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:41.176524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:41.177566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:41.186522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:41.186971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:41.187757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:41.188197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:41.323706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:41.332421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c939639b-41d3-4745-a57c-b35f34c434de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.162183 Nov 10 16:14:41.332998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 910/1781] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:41 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:42.353186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:42.354221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:42.361810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:42.362282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:42.363069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:42.363492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:42.512301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:42.521303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7b672a4b-ddbf-4c7b-a88b-3910e400fad7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174440 Nov 10 16:14:42.521883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 872/1782] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:42 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:43.542780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:43.543758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:43.554715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:43.555524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:43.556800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:43.557514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:43.700262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:43.708502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5809eb7b-a7ad-409b-977a-fdb900c5c1f7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172213 Nov 10 16:14:43.709079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 911/1783] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:43 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:44.728925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:44.729928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:44.740652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:44.741389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:44.742725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:44.743436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:44.879728 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:44.888116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-30417df7-6598-41a9-9daa-fba44c7cceec tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165272 Nov 10 16:14:44.888660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 873/1784] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:44 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:45.907777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:45.908658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:45.916070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:45.916512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:45.917290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:45.917717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:46.081993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:46.092383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ea536973-4fb2-4c05-a325-551a59027b34 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.189660 Nov 10 16:14:46.093001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 912/1785] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:45 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:47.114940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:47.115802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:47.126262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:47.126737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:47.127512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:47.127942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:47.270209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:47.282128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7299b481-0e18-489c-ab6d-053ef5c060a6 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173538 Nov 10 16:14:47.282956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 874/1786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:47 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:48.307622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:48.308470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:48.317877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:48.318376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:48.319204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:48.319649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:48.466301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:48.474651 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dcd21661-1bbf-4c72-ad25-9a44309a68de tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172900 Nov 10 16:14:48.475203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 913/1787] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:48 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:49.496823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:49.498152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:49.504896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:49.505342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:49.506127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:49.506585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:49.658796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:49.671063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fa45e765-c1ce-4704-bad3-b99c89ccd5b8 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177740 Nov 10 16:14:49.671826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 875/1788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:49 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:50.691879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:50.692676 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:50.701040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:50.701594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:50.702609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:50.703140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:50.841555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:50.850330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6919326c-9dc5-46cc-bdc4-44eec14e3422 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.164114 Nov 10 16:14:50.850913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 914/1789] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:50 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:51.871513 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:51.872443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:51.882878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:51.883630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:51.884902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:51.885608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:52.032544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:52.042034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-97dcb0c7-614d-40a5-bcc6-8f744e70d78a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176946 Nov 10 16:14:52.042634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 876/1790] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:51 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:53.060333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:53.061059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:53.069041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:53.069417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:53.070201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:53.070725 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:53.207500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:53.215947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-eab2a996-13d0-47ae-aa92-b6a0120f0b84 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.160303 Nov 10 16:14:53.216523 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 915/1791] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:53 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:54.232945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:54.233584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:54.240549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:54.241008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:54.241799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:54.242264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:54.396208 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:54.408385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d1886c39-e283-4b87-b1ee-82ac8ffbcd52 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.178943 Nov 10 16:14:54.409197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 877/1792] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:54 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:55.427916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:55.428622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:55.436277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:55.436811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:55.437716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:55.438398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:55.580669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:55.589422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9f4408da-faa4-420c-8cb7-bef9e6554916 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166543 Nov 10 16:14:55.590031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 916/1793] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:55 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:56.611554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:56.612466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:56.623412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:56.624130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:56.625381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:56.626134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:56.760129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:56.770195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-52d8b6ce-170c-4bce-8a72-a84c9cfdcc1a tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.165088 Nov 10 16:14:56.770788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 878/1794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:56 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:57.789067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:57.789767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:57.797406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:57.797939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:57.798886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:57.799397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:57.943201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:57.951561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e695b438-094c-40b0-a658-f20186854c2e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167442 Nov 10 16:14:57.952135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 917/1795] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:57 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:14:58.968758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:14:58.969453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:14:58.976713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:58.977180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:58.977953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:14:58.978423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:14:59.114557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:14:59.123343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f5a3f0b9-8575-431b-9e2e-712e914ffc10 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.158350 Nov 10 16:14:59.123909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 879/1796] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:14:58 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:00.148027 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:00.148663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:00.155472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:00.155851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:00.156632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:00.157066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:00.303419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:00.311516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a81ff355-5a88-469a-8ad8-15628ca873bb tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168217 Nov 10 16:15:00.312088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 918/1797] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:00 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:01.333088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:01.334041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:01.342189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:01.342648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:01.343415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:01.343837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:01.476357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:01.484781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-45d2cda1-193f-4467-9c28-200ab1a5e02e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.157972 Nov 10 16:15:01.485319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 880/1798] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:01 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:02.507823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:02.508466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:02.515931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:02.516388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:02.517180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:02.517611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:02.662994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:02.680029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53bfb3b8-c32c-4ca7-b4d2-b5fbe0d5c1dd tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.177909 Nov 10 16:15:02.680604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 919/1799] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:02 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:03.704634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:03.705285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:03.711906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:03.712353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:03.713211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:03.713642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:03.907484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:03.921175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-100e2d6b-d3d8-4ac0-b07a-d60b4492603e tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.220521 Nov 10 16:15:03.925996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 881/1800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:03 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:04.948682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:04.949680 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:04.960361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:04.961141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:04.962486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:04.963259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:05.114338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:05.122653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bce9d183-24a2-467b-9ab5-e388b75e57b3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180283 Nov 10 16:15:05.123227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 920/1801] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:04 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:06.151041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:06.152059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:06.159471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:06.159915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:06.160691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:06.161123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:06.309885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:06.319674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9697d95c-7e6b-4775-b50d-4cecb30018d7 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.176005 Nov 10 16:15:06.320403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 882/1802] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:06 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:07.339835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:07.340695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:07.350399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:07.351097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:07.352294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:07.352950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:07.491841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:07.500372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-26822dcd-2c98-4e70-95eb-d90e5bc32554 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166309 Nov 10 16:15:07.500868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 921/1803] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:07 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:08.523724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:08.524406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:08.531282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:08.531737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:08.532543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:08.532966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:08.669639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:08.681530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6146a635-1a9e-497d-b620-b84441dfcc72 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.161169 Nov 10 16:15:08.682264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 883/1804] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:08 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:09.699044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:09.699644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:09.706616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:09.707071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:09.707842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:09.708278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:09.853476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:09.862309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dd68eec5-5de6-4df2-8a66-10f6726c860f tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166739 Nov 10 16:15:09.862973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 922/1805] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:09 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:10.885104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:10.886123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:10.897494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:10.898258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:10.899582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:10.900299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:10.945356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:15:10.945987 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:15:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:15:11.037613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:11.048108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3048407b-77d6-4444-91ae-a72f0433e895 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.169351 Nov 10 16:15:11.048681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 884/1806] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:10 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:12.069031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:12.070066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:12.081286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:12.082022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:12.083355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:12.084067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:12.233375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:12.241871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f6d49514-0ffc-4364-b7bc-6ba466fb87e3 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.178821 Nov 10 16:15:12.242488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 923/1807] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:12 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:13.259759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:13.260433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:13.268172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:13.268609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:13.269409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:13.269830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:13.413694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:13.422891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d2d9970f-ac1c-431a-8976-446b8f217112 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.167324 Nov 10 16:15:13.423474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 885/1808] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:13 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:14.442299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:14.443072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:14.451689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:14.452278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:14.453282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:14.453854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:14.602817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:14.612306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c4459e84-0ac7-4c81-9591-c963abcf4605 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.174860 Nov 10 16:15:14.612859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 924/1809] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:14 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:15.633143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:15.634040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:15.642897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:15.643333 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:15.644104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:15.644532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:15.790115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:15.798932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6370b94b-4687-40a0-a8bf-b6f700682013 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.172141 Nov 10 16:15:15.799497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 886/1810] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:15 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:16.819184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:16.819826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:16.829046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:16.829506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:16.830304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:16.830728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:16.971210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:16.979742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d7a5a44e-be7f-4ebd-8346-7ec304d0d846 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.166709 Nov 10 16:15:16.980478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 925/1811] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:16 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:17.997812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:17.998570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:18.005448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:18.005785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:18.006617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:18.007039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:18.142428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:18.153762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c42bdf4d-5bd2-4884-a248-1ea06bff8ad1 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.159946 Nov 10 16:15:18.154384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 887/1812] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:17 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:19.175612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:19.176187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:19.182920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:19.183365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:19.184129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:19.184554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:19.320324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:19.328953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d1580357-3c89-4623-8704-f34a1451f8aa tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.156973 Nov 10 16:15:19.329492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 926/1813] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:19 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:20.346626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:20.347223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:20.353518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:20.353942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:20.354736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:20.355163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:20.499633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:20.511505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0d292553-2024-4c9b-9f0a-c05d0c384239 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.168749 Nov 10 16:15:20.512741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 888/1814] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:20 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:21.533008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:21.533654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:21.543179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:21.543819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:21.544937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:21.545447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:21.698620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:21.707152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee50cad9-fb27-4cce-8094-b5af29122024 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.180716 Nov 10 16:15:21.707727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 927/1815] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:21 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:22.728911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:22.730402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:22.740460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:22.741329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:22.742703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:22.743405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:22.885283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:22.895610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c45e7fe6-c999-4a52-90d4-e0d84b872a47 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.173434 Nov 10 16:15:22.896178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 889/1816] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:22 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:15:23.916910 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:15:23.917953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] [instance: 61231004-dfd0-4036-89ca-e554dfb3876c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:15:23.926699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:23.927150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:23.927930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:15:23.928391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:15:24.296465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c17a5a54a8b40f9901f9b86b4353955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:15:24.304646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e768188d-df16-4436-8cba-9c3b84f80700 tempest-VolumesSnapshotTestJSON-290951628 tempest-VolumesSnapshotTestJSON-290951628-project] 10.222.0.60 "GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c" status: 200 len: 1560 microversion: 2.1 time: 0.394217 Nov 10 16:15:24.305248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 928/1817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:15:23 2021] GET /compute/v2.1/servers/61231004-dfd0-4036-89ca-e554dfb3876c => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:16:21.753345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:16:21.753992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:16:21.760446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:16:21.761706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:16:21.762522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:16:21.763028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:16:21.777209 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. Nov 10 16:16:21.777811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:16:21.778668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2a8b398d-7d28-4593-8807-2e8a4916fed7 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 404 len: 111 microversion: 2.1 time: 0.029332 Nov 10 16:16:21.779338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 890/1818] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:16:21 2021] DELETE /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:16:21.787499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:16:21.788112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 5862436c-b538-451b-8764-b38c847b6a22] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:16:21.798100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:16:21.798100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:16:21.798100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:16:21.798100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:16:21.809983 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. Nov 10 16:16:21.810625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 5862436c-b538-451b-8764-b38c847b6a22 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:16:21.811524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-69f0a1dd-214c-4d4a-ade7-1db9def7fc92 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22" status: 404 len: 111 microversion: 2.1 time: 0.027747 Nov 10 16:16:21.812069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 929/1819] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:16:21 2021] GET /compute/v2.1/servers/5862436c-b538-451b-8764-b38c847b6a22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:16:25.327246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:16:25.328022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:16:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:16:37.303937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:16:37.304755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:16:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:16:43.628390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:16:43.629440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:16:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:16:49.970570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:16:49.971507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:16:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:18:30.964515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:18:30.965052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:18:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:19:45.351437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:19:45.352218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:19:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:19:57.328137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:19:57.329093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:19:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:20:03.656258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:20:03.657118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:20:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:20:09.998650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:20:09.998650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:20:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:21:38.402041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f9a7afd-30b2-4387-bac9-ba645cad199c] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 10 16:21:38.405767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:38.406257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:38.413483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:38.413930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:38.414757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:38.415245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:38.439798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:21:38.520066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9e252eab-2293-4a8b-9714-857fb21b515d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 204 len: 0 microversion: 2.1 time: 0.119723 Nov 10 16:21:38.520652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 891/1820] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:21:38 2021] DELETE /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:21:38.527696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 10 16:21:38.531186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:38.531798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:38.537986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:38.538520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:38.539311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:38.539750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:38.877402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:38.885590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dbc73db6-afe4-44c6-b743-676136df2bfc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1506 microversion: 2.1 time: 0.360798 Nov 10 16:21:38.886345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 930/1821] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:38 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:39.593756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f9a7afd-30b2-4387-bac9-ba645cad199c] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57422. Nov 10 16:21:39.705568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-8afae124-fb64-4b3a-b993-9b2360ff54ef req-2b741a6d-68e6-4c7a-aeb5-03a0effdfd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db7e16c-41b1-448e-bb30-c71d98091b75", "name": "network-vif-deleted", "tag": "a9c26607-bfdd-42a8-90aa-11acb5442ba8"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:21:39.707138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:21:39.707138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:21:39.714663 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-8afae124-fb64-4b3a-b993-9b2360ff54ef req-2b741a6d-68e6-4c7a-aeb5-03a0effdfd09 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:39.715066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-8afae124-fb64-4b3a-b993-9b2360ff54ef req-2b741a6d-68e6-4c7a-aeb5-03a0effdfd09 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:39.725793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-8afae124-fb64-4b3a-b993-9b2360ff54ef req-2b741a6d-68e6-4c7a-aeb5-03a0effdfd09 service nova] Creating event network-vif-deleted:a9c26607-bfdd-42a8-90aa-11acb5442ba8 for instance 6db7e16c-41b1-448e-bb30-c71d98091b75 on hv-cinder-81708 Nov 10 16:21:39.730691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-8afae124-fb64-4b3a-b993-9b2360ff54ef req-2b741a6d-68e6-4c7a-aeb5-03a0effdfd09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165620 Nov 10 16:21:39.731270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 892/1822] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:21:39.904850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:39.905460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:39.925452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:39.925794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:39.926611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:39.927047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:39.933110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57426. Nov 10 16:21:39.961080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:39.961528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:39.961969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lazy-loading 'fault' on Instance uuid 6db7e16c-41b1-448e-bb30-c71d98091b75 {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:21:40.010564 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:40.018830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-be500815-f659-4701-b98c-8c6a14e28536 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 200 len: 1311 microversion: 2.1 time: 0.119475 Nov 10 16:21:40.019399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 931/1823] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:39 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:41.044221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:41.045448 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: 6db7e16c-41b1-448e-bb30-c71d98091b75] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:41.056049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.056797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.058080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.058845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.074896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] HTTP exception thrown: Instance 6db7e16c-41b1-448e-bb30-c71d98091b75 could not be found. Nov 10 16:21:41.075485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Returning 404 to user: Instance 6db7e16c-41b1-448e-bb30-c71d98091b75 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:21:41.076325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-65735857-e36e-4cee-8fca-25b3656d6384 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75" status: 404 len: 111 microversion: 2.1 time: 0.039772 Nov 10 16:21:41.077062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 893/1824] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:41 2021] GET /compute/v2.1/servers/6db7e16c-41b1-448e-bb30-c71d98091b75 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:21:41.085447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:41.085999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:41.092768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.093214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.093999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.094473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.119960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:21:41.201897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f0daba5-57fc-450e-a3df-650cd59d8528 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 204 len: 0 microversion: 2.1 time: 0.120022 Nov 10 16:21:41.202536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 932/1825] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:21:41 2021] DELETE /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:21:41.211905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:41.212882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:41.222751 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.223205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.224056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:41.224487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:41.484015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:41.494433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c992c1e2-0c89-4bfd-8f6e-bf4c8416b598 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1566 microversion: 2.1 time: 0.286550 Nov 10 16:21:41.495254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 894/1826] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:42.252231 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-0056c011-d199-49c0-9e27-27f4e6ef63ed req-2a96a54d-c059-4e55-97bc-fe53b1cf93b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f732db3a-a74d-4503-8538-9bcb4136479a", "name": "network-vif-deleted", "tag": "f1350101-b68f-49c3-a23d-a1b73c5ad182"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:21:42.254376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:21:42.254376 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:21:42.262254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0056c011-d199-49c0-9e27-27f4e6ef63ed req-2a96a54d-c059-4e55-97bc-fe53b1cf93b0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:42.262716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0056c011-d199-49c0-9e27-27f4e6ef63ed req-2a96a54d-c059-4e55-97bc-fe53b1cf93b0 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:42.274255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-0056c011-d199-49c0-9e27-27f4e6ef63ed req-2a96a54d-c059-4e55-97bc-fe53b1cf93b0 service nova] Creating event network-vif-deleted:f1350101-b68f-49c3-a23d-a1b73c5ad182 for instance f732db3a-a74d-4503-8538-9bcb4136479a on hv-cinder-81708 Nov 10 16:21:42.279934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-0056c011-d199-49c0-9e27-27f4e6ef63ed req-2a96a54d-c059-4e55-97bc-fe53b1cf93b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Nov 10 16:21:42.280515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 933/1827] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:21:42.518859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:42.519704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:42.530391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:42.531115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:42.532385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:42.533187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:42.598226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:42.610441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-65d4dc15-9000-4994-adca-604c03bbf073 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097464 Nov 10 16:21:42.611404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 895/1828] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:43.629625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:43.630327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:43.636974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:43.637409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:43.638184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:43.638638 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:43.702573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:43.711161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1a011103-e670-44d6-a9cd-8514e72f8455 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086676 Nov 10 16:21:43.711740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 934/1829] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:44.733264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:44.734152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:44.744792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:44.745516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:44.746846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:44.747538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:44.820205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:44.828672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7175cdd4-1dca-4dd2-80ec-cd93cfbcd642 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101926 Nov 10 16:21:44.829222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 896/1830] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:45.849837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:45.850909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:45.861314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:45.862396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:45.863320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:45.863811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:45.930716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:45.939182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b4719894-7c67-4c77-b2f6-ba29a06121b1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096134 Nov 10 16:21:45.939737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 935/1831] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:46.957713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:46.958486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:46.966186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:46.966705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:46.967605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:46.968130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:47.033456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:47.042479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-912c96f3-d47a-4209-aef5-de8ec7a1f710 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089408 Nov 10 16:21:47.043036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 897/1832] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:48.068143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:48.068923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:48.079159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:48.079822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:48.081023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:48.081539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:48.153504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:48.161667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b9c4d79a-a759-43d5-b9bc-8d2724619818 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099982 Nov 10 16:21:48.162296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 936/1833] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:49.180012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:49.180765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:49.189063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:49.189590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:49.190684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:49.191114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:49.262278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:49.270710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4a0ed508-4c02-4cae-a0c7-f52b2706b164 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095377 Nov 10 16:21:49.271270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 898/1834] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:50.288364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:50.288985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:50.295429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:50.295873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:50.296669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:50.297097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:50.363270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:50.376447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d7298d40-b0f8-4a20-bb39-535440e28406 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091509 Nov 10 16:21:50.377313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 937/1835] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:50.983435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:21:50.983780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:21:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:21:51.399669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:51.400684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:51.411037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:51.411465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:51.412255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:51.412683 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:51.474190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:51.482221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4ce136e9-afe4-4e93-8bf8-b50138b51126 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090310 Nov 10 16:21:51.482821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 899/1836] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:52.505206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:52.506107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:52.516835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:52.518296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:52.519134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:52.519569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:52.580429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:52.589479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1d40bfd7-2886-4195-ba6c-28a89a367815 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091743 Nov 10 16:21:52.590016 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 938/1837] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:53.609517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:53.610501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:53.621441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:53.622204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:53.623502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:53.624173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:53.706773 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:53.719878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-063bb8f2-9d3b-45f5-8332-78eb3be49a42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.116295 Nov 10 16:21:53.720767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 900/1838] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:54.746768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:54.747729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:54.758776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:54.759527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:54.760812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:54.761542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:54.824941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:54.836549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d63b21d1-6ba0-4071-9e2d-03798ff65d96 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095609 Nov 10 16:21:54.837357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 939/1839] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:55.857374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:55.858402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:55.869123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:55.869860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:55.871193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:55.871911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:55.937863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:55.948140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d5d625b3-a88b-4d6c-85e5-a703b38f4c85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096680 Nov 10 16:21:55.948815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 901/1840] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:56.974729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:56.975717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:56.986374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:56.987201 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:56.988004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:56.988408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:57.059996 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:57.070596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa0df066-4db8-4ba0-8fa8-c5899c78e982 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.102547 Nov 10 16:21:57.071310 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 940/1841] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:58.092486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:58.093415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:58.101999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:58.102466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:58.103227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:58.103652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:58.167057 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:58.179629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-04f37826-335a-4b99-852b-cc027e060448 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092860 Nov 10 16:21:58.180420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 902/1842] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:21:59.200041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:21:59.200750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:21:59.207483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:59.208152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:59.208946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:21:59.209391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:21:59.271050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:21:59.279130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-46864926-aa3a-4054-bd46-b716e92f2b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082976 Nov 10 16:21:59.279703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 941/1843] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:21:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:00.300844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:00.302029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:00.312836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:00.313576 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:00.314935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:00.315646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:00.393656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:00.402211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c4fbc03e-703b-4b12-9c9c-26d5d972bba5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.108457 Nov 10 16:22:00.402755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 903/1844] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:01.421585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:01.422182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:01.429091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:01.429545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:01.430380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:01.430803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:01.500283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:01.509637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3a7898c9-78ee-4911-90fa-6db31fa9ff8a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092082 Nov 10 16:22:01.510470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 942/1845] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:02.531793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:02.532691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:02.541194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:02.541642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:02.542458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:02.542888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:02.604300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:02.612850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6c943cb6-cbd9-437d-a7a0-9019ce1552d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088431 Nov 10 16:22:02.613413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 904/1846] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:03.637354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:03.638321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:03.648179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:03.648628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:03.649410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:03.649836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:03.718329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:03.726940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-71b9c703-6fc8-442d-92bb-69910299b870 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099536 Nov 10 16:22:03.727516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 943/1847] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:04.752583 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:04.753951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:04.761488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:04.761933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:04.762736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:04.763164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:04.833009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:04.845345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3aabed9a-a303-41c5-adfc-6d3682ebc711 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098874 Nov 10 16:22:04.853885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 905/1848] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:05.876585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:05.877380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:05.887552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:05.888147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:05.889180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:05.889729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:05.957685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:05.967254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7eaedc13-2c5b-4dc6-9807-79554e92d318 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096053 Nov 10 16:22:05.967826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 944/1849] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:06.987243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:06.988266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:06.998087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:06.998825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:07.000008 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:07.000726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:07.068334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:07.076970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2783e42a-dbcf-49ff-8353-331e539a356f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095358 Nov 10 16:22:07.077518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 906/1850] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:08.097874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:08.098540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:08.105789 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:08.106269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:08.107473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:08.107930 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:08.169149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:08.177353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e050de30-615b-4707-b33c-972688d86482 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083275 Nov 10 16:22:08.177913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 945/1851] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:09.196748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:09.197466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:09.205544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:09.206090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:09.207104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:09.207644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:09.273584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:09.282086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dfab2c4e-abc6-413f-9074-7510528875a3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091014 Nov 10 16:22:09.282709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 907/1852] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:10.299574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:10.300143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:10.306850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:10.307301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:10.308075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:10.308519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:10.378747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:10.386868 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-95b68af2-87e8-4138-9295-61625a27d4ba tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091196 Nov 10 16:22:10.387473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 946/1853] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:11.404629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:11.405224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:11.411783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:11.412245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:11.413648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:11.414123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:11.477219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:11.485666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3ccc3e6e-8007-451c-8d0b-b24ca99c2187 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085076 Nov 10 16:22:11.486286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 908/1854] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:12.502915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:12.503837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:12.510842 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:12.511293 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:12.512081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:12.512517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:12.577721 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:12.586056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b0f9e047-0a32-4f58-9ef1-d192fd7b6540 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086922 Nov 10 16:22:12.586678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 947/1855] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:13.605053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:13.605992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:13.613420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:13.613852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:13.614693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:13.615123 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:13.693312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:13.702286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c1a47ca6-108b-42ca-ad53-1082b349204a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.102553 Nov 10 16:22:13.702853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 909/1856] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:14.723422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:14.724370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:14.735437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:14.736197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:14.737456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:14.738202 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:14.815348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:14.823861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-629e780d-2ecb-47ed-a0aa-2fc4a1023f60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.106884 Nov 10 16:22:14.824445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 948/1857] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:15.840661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:15.841294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:15.848120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:15.848562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:15.849317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:15.849746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:15.915856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:15.924396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96ced970-a299-46dd-9e33-7aedc3654747 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087587 Nov 10 16:22:15.925331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 910/1858] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:16.949277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:16.949938 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:16.956804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:16.957270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:16.958053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:16.958535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:17.020493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:17.029330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ece8dcbd-f655-4f97-9722-02a2f2087d95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084735 Nov 10 16:22:17.029895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 949/1859] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:18.050749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:18.051733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:18.062846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:18.063589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:18.064875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:18.065643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:18.131472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:18.140145 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5c665cb2-40fc-437c-b5ec-46c09e1b9433 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095652 Nov 10 16:22:18.141098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 911/1860] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:19.161231 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:19.162324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:19.173353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:19.174105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:19.175445 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:19.176174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:19.255438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:19.264038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c684e879-7d72-4825-affc-d4804da56c38 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.109036 Nov 10 16:22:19.264600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 950/1861] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:20.281097 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:20.281670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:20.288503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:20.288942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:20.289712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:20.290137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:20.354724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:20.365549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06d29303-c420-4e1f-b77d-55827ff7f72b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087901 Nov 10 16:22:20.366495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 912/1862] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:21.394341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:21.395363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:21.404252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:21.404699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:21.405474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:21.405902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:21.476745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:21.485064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a6c3ba7d-e2c6-4679-953b-de98f71e1531 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098680 Nov 10 16:22:21.485640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 951/1863] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:22.501329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:22.501949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:22.508989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.509440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.510222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.510674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.569095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:22.569592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:22.575405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:22.577235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.577850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.578597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.579036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.585072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4cca9ffc-8e40-4374-9da7-8afe8dc3e6b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087705 Nov 10 16:22:22.585707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 913/1864] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:22.594873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. Nov 10 16:22:22.595479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:22:22.596325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4406603d-a45c-4147-bc83-34dd18427eb4 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 404 len: 111 microversion: 2.1 time: 0.031063 Nov 10 16:22:22.596881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 952/1865] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:22:22 2021] DELETE /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 10 16:22:22.604905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:22.605534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] [instance: 30898884-8dbc-4a4a-a1ac-e586e9254eaa] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:22.611483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.611915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.612687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:22.613114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:22.626412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] HTTP exception thrown: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. Nov 10 16:22:22.626981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] Returning 404 to user: Instance 30898884-8dbc-4a4a-a1ac-e586e9254eaa could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:22:22.627788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-eff7ac28-94e4-4461-8880-7c00386204e9 tempest-AttachVolumeShelveTestJSON-1490712220 tempest-AttachVolumeShelveTestJSON-1490712220-project] 10.222.0.60 "GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa" status: 404 len: 111 microversion: 2.1 time: 0.026702 Nov 10 16:22:22.628635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 914/1866] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:22 2021] GET /compute/v2.1/servers/30898884-8dbc-4a4a-a1ac-e586e9254eaa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:22:23.602546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:23.603187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:23.609613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:23.610098 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:23.610972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:23.611389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:23.693927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:23.703131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-df3900d9-1c5f-4353-8469-68f73d346e62 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104753 Nov 10 16:22:23.703953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 953/1867] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:24.719915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:24.720501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:24.727253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:24.727694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:24.728470 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:24.728907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:24.795810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:24.804570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-43f84585-1a44-41c7-9d29-2782ce8a4b42 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088615 Nov 10 16:22:24.805124 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 915/1868] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:25.822457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:25.823124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:25.830535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:25.830798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:25.831586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:25.832059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:26.063550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:26.074538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ebaa2188-b9f2-49f0-b5b2-36b6018e145c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.255518 Nov 10 16:22:26.076382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 954/1869] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:27.091763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:27.092495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:27.099572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:27.100022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:27.100838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:27.101271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:27.167898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:27.176162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-348474a3-666c-49d6-b5c2-13456fb26ba1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088114 Nov 10 16:22:27.176799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 916/1870] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:28.194233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:28.194869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:28.201767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:28.202335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:28.203153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:28.203586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:28.273798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:28.282736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-67c86371-fd01-4d7d-b70c-5e2d58e1a8ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092226 Nov 10 16:22:28.283967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 955/1871] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:29.300386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:29.301026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:29.307960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:29.308496 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:29.309342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:29.309782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:29.407708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:29.415802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a8f1f5d3-1c3c-4ec4-8880-7ed16cd8f46d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.119072 Nov 10 16:22:29.416408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 917/1872] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:30.433042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:30.434489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:30.441476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:30.442190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:30.443188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:30.443633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:30.525820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:30.534507 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-715a619b-3858-4b5c-922c-a875f767f8f5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.105387 Nov 10 16:22:30.535118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 956/1873] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:31.554246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:31.555656 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:31.565111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:31.565977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:31.568970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:31.570617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:31.653146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:31.661514 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ed628b70-338f-4c9e-a740-885a0bf3fda9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.113366 Nov 10 16:22:31.670880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 918/1874] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:31.960484 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: .version_select at 0x7faa9b47c0d0>, body: {"keypair": {"name": "tempest-keypair-220523828"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:31.974706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:22:31.978934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:22:32.380320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:22:32.384294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:22:32.398291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7bb94ebc-1ec2-4bdb-a1e5-87b1d97d9a80 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.564882 Nov 10 16:22:32.398878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 957/1875] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Nov 10 16:22:31 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:32.681326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:32.682194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:32.689239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:32.689768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:32.690847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:32.691339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:32.763235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:32.779271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1fc5ea93-26d5-4795-a84b-82c00a8473f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104556 Nov 10 16:22:32.780300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 919/1876] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:33.743084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1575258478", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5016f302-6b13-48d0-b6e2-188d1a94cbfc"}], "security_groups": [{"name": "tempest-securitygroup--994465022"}], "key_name": "tempest-keypair-220523828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:33.796770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:33.797578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:33.803830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:33.804572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:33.805577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:33.806405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:33.872912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] validate_networks() for [('5016f302-6b13-48d0-b6e2-188d1a94cbfc', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:22:33.894122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:33.902508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-26459110-6fd6-4e30-8bc8-86b37cdfcbeb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.110093 Nov 10 16:22:33.903191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 920/1877] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:34.324040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:22:34.324467 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:22:34.324945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:22:34.325358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:22:34.325826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:22:34.335345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:34.335874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:34.336748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:34.337244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:34.359540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:22:34.364607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:22:34.378225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:22:34.380520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:22:34.437746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d840972d-69f8-4ce7-979e-ae2959332472 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.699242 Nov 10 16:22:34.439540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 958/1878] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:22:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:22:34.450593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-12c9d3d5-e042-4dbe-8334-6565d1295f7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:34.452029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-12c9d3d5-e042-4dbe-8334-6565d1295f7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:34.526822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-12c9d3d5-e042-4dbe-8334-6565d1295f7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:34.538297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-12c9d3d5-e042-4dbe-8334-6565d1295f7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1237 microversion: 2.1 time: 0.091865 Nov 10 16:22:34.539236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 921/1879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:34 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:22:34.919612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:34.920880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:34.927425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:34.928134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:34.929337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:34.929950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:34.993581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:35.002304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-60826bb9-0d22-4a92-b976-97291db5bd10 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086855 Nov 10 16:22:35.003592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 959/1880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:35.555690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:35.556288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:35.563199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:35.563633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:35.564718 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:35.565128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:35.633815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:35.642714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f2ff7586-9d7d-4551-bbc8-da1d032cccac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1289 microversion: 2.1 time: 0.090668 Nov 10 16:22:35.643336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 922/1881] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:35 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:36.023146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:36.024052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:36.033976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:36.034748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:36.035994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:36.036519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:36.116137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:36.124537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7cb1ba63-02e2-4eb3-8ba9-28f17b519573 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.107764 Nov 10 16:22:36.125091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 960/1882] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:36.661968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:36.662605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:36.671236 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:36.671676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:36.672460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:36.672887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:36.875362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:36.883494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3c9d9c65-b514-4e19-aed2-44f524c45b2f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.227100 Nov 10 16:22:36.884154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 923/1883] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:36 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:37.125539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-0455b0f1-6613-4252-8641-af20a4922121 req-034c96b2-b2d2-416b-b634-107d1065786c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411c29a5-496c-4064-a314-d21bd0293673", "tag": "2d9ddefc-f5c6-4117-968a-4cad125fbfdc"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:37.128318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:22:37.128318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:22:37.138671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0455b0f1-6613-4252-8641-af20a4922121 req-034c96b2-b2d2-416b-b634-107d1065786c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:37.142393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:37.142914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:37.155727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:37.156277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:37.156941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:37.157369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:37.157802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0455b0f1-6613-4252-8641-af20a4922121 req-034c96b2-b2d2-416b-b634-107d1065786c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:37.171556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-0455b0f1-6613-4252-8641-af20a4922121 req-034c96b2-b2d2-416b-b634-107d1065786c service nova] Creating event network-changed:2d9ddefc-f5c6-4117-968a-4cad125fbfdc for instance 411c29a5-496c-4064-a314-d21bd0293673 on hv-cinder-81708 Nov 10 16:22:37.177964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-0455b0f1-6613-4252-8641-af20a4922121 req-034c96b2-b2d2-416b-b634-107d1065786c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059158 Nov 10 16:22:37.179244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 961/1884] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:22:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:22:37.237555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:37.250357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9f389eda-9e8e-45af-a5df-b0ddeb9237af tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.112164 Nov 10 16:22:37.250961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 924/1885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:37.901490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:37.903503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:37.910423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:37.911372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:37.912246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:37.912751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:38.267947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:38.268594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:38.275521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:38.275981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:38.276764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:38.277262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:38.375081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:38.383880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b6c5f27c-235b-4e59-9384-0603b402bbc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.119733 Nov 10 16:22:38.384428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 925/1886] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:38.412685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:38.420621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aa4bcd86-cd39-4e05-8dc5-38f2e28afe4c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.523278 Nov 10 16:22:38.421237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 962/1887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:37 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:39.404518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:39.405135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:39.411878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:39.412328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:39.413109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:39.413542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:39.437430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:39.438116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:39.445234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:39.445799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:39.446690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:39.447190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:39.478433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:39.486962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-79648a87-1921-4222-9719-83094efea3ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088442 Nov 10 16:22:39.496351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 926/1888] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:39.585451 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:39.593744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-45f338ce-e061-4764-857d-e5497c2738a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.160495 Nov 10 16:22:39.594425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 963/1889] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:39 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:40.507979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:40.508917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:40.516990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:40.517437 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:40.518250 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:40.518681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:40.589673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:40.602109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-33530841-5c32-41e2-93e8-c607bb839499 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100523 Nov 10 16:22:40.602840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 927/1890] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:40.610801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:40.611365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:40.617747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:40.618205 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:40.618999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:40.619439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:40.766306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:40.774264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3958f1e3-db9b-46ac-b9b4-2d5cea9cd335 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.167530 Nov 10 16:22:40.774833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 964/1891] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:40 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:41.618995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:41.620490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:41.627185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:41.628035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:41.628711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:41.629140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:41.663280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-80aced6a-a752-4af4-ad7c-dffbcb21de98 req-81038f08-0f19-4a09-be29-e6dcb1fa9859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411c29a5-496c-4064-a314-d21bd0293673", "name": "network-vif-plugged", "status": "completed", "tag": "2d9ddefc-f5c6-4117-968a-4cad125fbfdc"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:41.665084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:22:41.665084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:22:41.673602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-80aced6a-a752-4af4-ad7c-dffbcb21de98 req-81038f08-0f19-4a09-be29-e6dcb1fa9859 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:41.674116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-80aced6a-a752-4af4-ad7c-dffbcb21de98 req-81038f08-0f19-4a09-be29-e6dcb1fa9859 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:41.685345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-80aced6a-a752-4af4-ad7c-dffbcb21de98 req-81038f08-0f19-4a09-be29-e6dcb1fa9859 service nova] Creating event network-vif-plugged:2d9ddefc-f5c6-4117-968a-4cad125fbfdc for instance 411c29a5-496c-4064-a314-d21bd0293673 on hv-cinder-81708 Nov 10 16:22:41.690725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-80aced6a-a752-4af4-ad7c-dffbcb21de98 req-81038f08-0f19-4a09-be29-e6dcb1fa9859 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096856 Nov 10 16:22:41.691763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 928/1892] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:22:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:22:41.693887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:41.702189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2a2ebdf5-d8c2-452b-86ea-798636e39009 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086880 Nov 10 16:22:41.702788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 965/1893] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:41.792149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:41.792844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:41.800894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:41.801533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:41.802366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:41.802810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:41.988888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:41.996812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a4cb666a-aecf-4e1c-becb-3cdaa958b5fb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.208956 Nov 10 16:22:41.997355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 929/1894] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:41 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:22:42.723955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:42.724869 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:42.734307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:42.734757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:42.735543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:42.736026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:42.797466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:42.806279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a57e7fd1-d115-48ec-9e00-2cabe3fd98a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088757 Nov 10 16:22:42.806853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 966/1895] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:43.014946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:43.015555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:43.023635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:43.024088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:43.024950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:43.025401 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:43.168980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:43.177199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7d1a873c-22ec-4d95-beb7-13d6cae70de7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1362 microversion: 2.1 time: 0.166584 Nov 10 16:22:43.177774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 930/1896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:43 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:43.826191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:43.827026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:43.836440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:43.837070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:43.838198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:43.838811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:43.900515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:43.908717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58184be1-40c6-4a72-955b-c686f4168fb2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087856 Nov 10 16:22:43.909309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 967/1897] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:44.195445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:44.196081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:44.203463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.203903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:44.204672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.205095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:44.353674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:44.362886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-067b73da-636a-45c3-aab5-efbda07e19f2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1548 microversion: 2.1 time: 0.171774 Nov 10 16:22:44.363456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 931/1898] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:44 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:44.384447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:44.384937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:44.392077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.392527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:44.393307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.393735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:44.485070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-32c2e21a-ff7b-44c4-a00f-7f9abfba2184 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104215 Nov 10 16:22:44.485724 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 968/1899] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Nov 10 16:22:44 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:22:44.925797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:44.926424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:44.932922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.933355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:44.934091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:44.934537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:45.004726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:45.013543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7e9d0a08-3425-41b7-9e15-0e9b522c6e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091292 Nov 10 16:22:45.014374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 932/1900] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:45.502192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:45.503440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:45.509787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-40c27928-7c34-4d7d-b1f5-cab37ef04a84 req-1a1225d8-4610-4cb7-b1ad-57d7ea2a58b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411c29a5-496c-4064-a314-d21bd0293673", "tag": "2d9ddefc-f5c6-4117-968a-4cad125fbfdc"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:45.510669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:45.511328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:22:45.511328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:22:45.511559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:45.512236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:45.512768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:45.519073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-40c27928-7c34-4d7d-b1f5-cab37ef04a84 req-1a1225d8-4610-4cb7-b1ad-57d7ea2a58b8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:45.519801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-40c27928-7c34-4d7d-b1f5-cab37ef04a84 req-1a1225d8-4610-4cb7-b1ad-57d7ea2a58b8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:45.531762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-40c27928-7c34-4d7d-b1f5-cab37ef04a84 req-1a1225d8-4610-4cb7-b1ad-57d7ea2a58b8 service nova] Creating event network-changed:2d9ddefc-f5c6-4117-968a-4cad125fbfdc for instance 411c29a5-496c-4064-a314-d21bd0293673 on hv-cinder-81708 Nov 10 16:22:45.539792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-40c27928-7c34-4d7d-b1f5-cab37ef04a84 req-1a1225d8-4610-4cb7-b1ad-57d7ea2a58b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033012 Nov 10 16:22:45.541257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 933/1901] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:22:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:22:45.580686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3827b2b9-76c3-4307-af77-9fa615bd404c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.082958 Nov 10 16:22:45.584606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 969/1902] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:45 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:46.031677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:46.032379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:46.038625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:46.039075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:46.039929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:46.040331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:46.104931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:46.112992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-31f74d9d-fd4f-4307-9169-3df1a69a29c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085809 Nov 10 16:22:46.113574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 934/1903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:46.592917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:46.593946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:46.608736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:46.609269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:46.610081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:46.610545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:46.671410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d0669290-c935-447e-bc17-e014e125e10a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.082692 Nov 10 16:22:46.672470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 970/1904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:46 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:47.130691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:47.131261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:47.138054 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:47.138528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:47.139474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:47.139933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:47.213012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:47.221852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3fc69619-baf1-48e6-acb4-2ee190f5177a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095380 Nov 10 16:22:47.222486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 935/1905] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:47.687476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:47.688505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:47.696188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:47.696642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:47.697437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:47.697879 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:47.758599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-89aa38ba-6222-4e72-8dc9-b3e9c2578676 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.077471 Nov 10 16:22:47.759322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 971/1906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:47 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:48.241923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:48.242568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:48.249520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:48.249952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:48.250756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:48.251184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:48.326615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:48.335157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e5df36f4-68ec-4a64-9f36-7eca9f260bd2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097058 Nov 10 16:22:48.335708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 936/1907] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:48.773406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:48.774516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:48.783506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:48.784036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:48.784965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:48.785486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:48.851229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-09726b58-67d7-4312-a29b-8ea556b30842 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.082668 Nov 10 16:22:48.851829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 972/1908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:48 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:49.357114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:49.357982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:49.369034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:49.369818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:49.371148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:49.371866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:49.439554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:49.448131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b8ef28d2-6f22-453c-a334-5d0ace674226 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097639 Nov 10 16:22:49.448689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 937/1909] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:49.865330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:49.866712 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:49.875744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:49.876198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:49.876991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:49.877748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:49.939334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53bd95c5-2ef2-4eb9-876e-5a09f14390df tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.079051 Nov 10 16:22:49.939963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 973/1910] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:49 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:50.469869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:50.471005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:50.481765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:50.482604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:50.483784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:50.484239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:50.555359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:50.565589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cddc008f-7698-4742-972d-d5662466eaed tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.102211 Nov 10 16:22:50.566181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 938/1911] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:50.954976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:50.955927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:50.963277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:50.963727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:50.964512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:50.964942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:51.024051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d1b647b4-a01b-4e71-b5e9-4dc5fbeaefb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.074773 Nov 10 16:22:51.024660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 974/1912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:50 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:51.582538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:51.583116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:51.589786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:51.590265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:51.591059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:51.591490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:51.658622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:51.666691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-58b95603-4e92-4bfd-9428-9fed634c5ba7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087966 Nov 10 16:22:51.667254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 939/1913] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:52.037514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:52.038668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:52.046784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:52.047298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:52.048173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:52.048667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:52.109012 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0c74e5e4-14db-4479-97fd-e5db037bec9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.075929 Nov 10 16:22:52.109639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 975/1914] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:52 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:52.687639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:52.688467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:52.698239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:52.698940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:52.700134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:52.700776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:52.762291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:52.774619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a32f6585-6ec2-441d-8d6e-2b53fae1a414 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092988 Nov 10 16:22:52.775355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 940/1915] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:53.124525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:53.125542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:53.133351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:53.133803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:53.134622 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:53.135064 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:53.205668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0ac68803-6bf4-457e-ac74-3d9ebb2bd7aa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.087615 Nov 10 16:22:53.206342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 976/1916] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:53 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:53.797481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:53.798525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:53.809120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:53.809853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:53.811201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:53.811811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:53.888472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:53.898070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-121e2b8f-9913-4ffb-a517-a72b9bbd17c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.106878 Nov 10 16:22:53.898654 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 941/1917] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:54.222337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:54.224065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:54.235157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:54.235609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:54.236404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:54.236847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:54.305665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b89fe207-916e-4dec-a052-6f94bc04bf15 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 14 microversion: 2.1 time: 0.090038 Nov 10 16:22:54.306630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 977/1918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:54 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:22:54.919289 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:54.920284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:54.927744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:54.928182 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:54.928946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:54.929367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:54.994188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:55.003085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-509c384f-1114-4bc5-9f95-82a3e3610ddd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090348 Nov 10 16:22:55.003631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 942/1919] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:55.319764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:55.321139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:55.330633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:55.331235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:55.332281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:55.332861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:55.411790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-07d0e646-e2c5-42eb-89c0-e5eafa34ad8e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 10658 microversion: 2.1 time: 0.097046 Nov 10 16:22:55.412777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 978/1920] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:55 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 10658 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:22:56.022675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:56.023298 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:56.032295 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:56.032736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:56.033507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:56.033932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:56.103259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:56.111871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-289de1f5-ad6f-41f0-8395-1a58f5ec47bd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095160 Nov 10 16:22:56.112439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 943/1921] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:56.430550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:56.432022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:56.443739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:56.444470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:56.445738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:56.446508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:56.530069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-705aa895-2f1d-450a-aef1-0e4408128942 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 17960 microversion: 2.1 time: 0.105671 Nov 10 16:22:56.531129 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 979/1922] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:56 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 17960 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:22:57.129505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:57.130137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:57.137002 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:57.137440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:57.138250 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:57.138717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:57.212957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:57.224460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-675115d5-312c-4a9a-a1f6-1461b71ba17c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098889 Nov 10 16:22:57.225335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 944/1923] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:57.547633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:57.549277 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:57.561023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:57.562144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:57.562985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:57.563463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:57.637790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-25ad3c1a-d958-4c84-b2cf-c145432596fc tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 19133 microversion: 2.1 time: 0.097040 Nov 10 16:22:57.638493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 980/1924] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:57 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 19133 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:22:58.245744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:58.246387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:58.253669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:58.254109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:58.254927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:58.255358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:58.316800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:58.324936 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c2610d70-79a8-4281-85f3-4f14c743b927 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083033 Nov 10 16:22:58.325534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 945/1925] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:58.650065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:58.650985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:58.658418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:58.658864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:58.659631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:58.660090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:58.744083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c2dc55d9-3cbd-424b-9255-d64de9133f0b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 21790 microversion: 2.1 time: 0.097698 Nov 10 16:22:58.745067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 981/1926] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:58 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 21790 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:22:59.345630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:22:59.346646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:59.357120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:59.357739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:59.359531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:59.360083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:59.432862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:22:59.444960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-32032d1f-196c-4860-b0db-2b564b93a83f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.105211 Nov 10 16:22:59.445819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 946/1927] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:22:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:22:59.762665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:22:59.764306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:22:59.776107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:59.776853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:59.778136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:22:59.779061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:22:59.855435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-78f857e1-97ee-4d85-a9d5-3f798958f802 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 23235 microversion: 2.1 time: 0.099051 Nov 10 16:22:59.856513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 982/1928] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:22:59 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 23235 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:00.468893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:00.470011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:00.476810 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:00.477223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:00.477998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:00.478454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:00.544611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:00.552924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-47779658-b644-470e-a67b-2d7a139248fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090084 Nov 10 16:23:00.553490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 947/1929] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:00.874439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:00.875988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:00.887871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:00.888625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:00.889974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:00.890744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:00.967597 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2e4aca4c-bee3-4ae5-a78f-c199d302fa3a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 24747 microversion: 2.1 time: 0.099761 Nov 10 16:23:00.968703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 983/1930] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:00 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 24747 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:01.573858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:01.574708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:01.583369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:01.583815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:01.584590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:01.585023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:01.659798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:01.673953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-117e27a6-d328-4503-b40f-869f74d62a61 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.105460 Nov 10 16:23:01.674561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 948/1931] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:01.986222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:01.987731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:01.999203 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:01.999934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:02.001308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:02.001765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:02.082939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cb8615fc-9294-43a1-a956-f73e8b1f1f12 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 26380 microversion: 2.1 time: 0.103628 Nov 10 16:23:02.083592 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 984/1932] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:01 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 26380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:02.692147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:02.692831 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:02.700141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:02.700625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:02.701467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:02.701940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:02.773166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:02.781444 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8502a00d-b192-4801-98a4-8a7622c507d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093858 Nov 10 16:23:02.782445 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 949/1933] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:03.100594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:03.102343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:03.113038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:03.113490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:03.114312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:03.114876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:03.195166 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1b1d2b09-9d87-4bae-baa4-7f9426834dd6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 27573 microversion: 2.1 time: 0.101505 Nov 10 16:23:03.195809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 985/1934] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:03 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 27573 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:03.801355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:03.802018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:03.808997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:03.809468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:03.810348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:03.810801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:03.880967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:03.889291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ca181bca-d31c-4fa9-b696-2b7be3a2f5a9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093060 Nov 10 16:23:03.889857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 950/1935] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:04.212711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:04.214218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:04.224544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:04.224998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:04.225793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:04.226270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:04.338836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-460185bf-7ce5-4fdf-9914-2304a1e6fb6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28082 microversion: 2.1 time: 0.132886 Nov 10 16:23:04.339859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 986/1936] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:04 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28082 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:04.910251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:04.910877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:04.917528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:04.917968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:04.918766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:04.919192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:04.980838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:04.989133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a30e1a20-3cd5-4133-8901-fea46df1c221 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084298 Nov 10 16:23:04.989691 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 951/1937] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:05.357745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:05.359436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:05.367871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:05.368335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:05.369118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:05.369542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:05.375454 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:23:05.375660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:23:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:23:05.448568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-adc49c01-c61b-4f45-b198-edd5c2983bc7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28225 microversion: 2.1 time: 0.097290 Nov 10 16:23:05.449600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 987/1938] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:05 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:06.010243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:06.011312 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:06.020777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:06.021214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:06.021982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:06.022433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:06.084545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:06.094196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-55229a0f-ab78-458e-9727-776dbfa208be tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090305 Nov 10 16:23:06.094914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 952/1939] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:06.463473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:06.464471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:06.471846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:06.472318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:06.473106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:06.473543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:06.541232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6480cfe5-6790-45d8-82a7-e967b0bc4bb9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28225 microversion: 2.1 time: 0.081751 Nov 10 16:23:06.541851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 988/1940] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:06 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:07.119991 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:07.120701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:07.129686 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:07.130127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:07.130964 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:07.131391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:07.191746 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:07.199955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-df757f4e-73d3-4b7b-aeda-b16c755b436e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086084 Nov 10 16:23:07.200530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 953/1941] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:07.557799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:07.559320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:07.569172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:07.569841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:07.571081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:07.572368 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:07.652332 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bc88c781-3066-4080-af16-cf73cd536391 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28515 microversion: 2.1 time: 0.101068 Nov 10 16:23:07.653154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 989/1942] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:07 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28515 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:08.218790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:08.219577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:08.227690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:08.228221 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:08.229161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:08.229675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:08.297025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:08.305879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1bee600a-97fe-4fb3-8a2f-f6a7d1131b52 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091531 Nov 10 16:23:08.306485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 954/1943] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:08.669416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:08.670821 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:08.680916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:08.681513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:08.682642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:08.683215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:08.767131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f796f48b-6b28-4278-95ee-32ff770cb5da tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28683 microversion: 2.1 time: 0.103279 Nov 10 16:23:08.767778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 990/1944] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:08 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28683 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:09.324821 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:09.325634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:09.335131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:09.335762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:09.336870 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:09.337483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:09.403698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:09.414219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-539fb36a-f2e3-48be-bb0d-870fa1f2ef02 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094647 Nov 10 16:23:09.414737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 955/1945] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:09.783975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:09.785706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:09.797084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:09.797804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:09.799173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:09.799896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:09.869760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2569d55d-16af-4216-be1d-e4f43b43a6ea tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28683 microversion: 2.1 time: 0.092532 Nov 10 16:23:09.870586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 991/1946] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:09 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28683 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:10.433290 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:10.433992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:10.442068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:10.442669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:10.443629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:10.444162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:10.521678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:10.529833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c0374600-821f-46c5-8ca4-7e28d78c13d0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101262 Nov 10 16:23:10.530441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 956/1947] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:10.887779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:10.889284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:10.900785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:10.901537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:10.902878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:10.903609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:10.969946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-06063c4f-c92e-4e68-aa08-d4f03c5bfb5f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 28683 microversion: 2.1 time: 0.089107 Nov 10 16:23:10.970612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 992/1948] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:10 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 28683 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:11.550234 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:11.551131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:11.562065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:11.562800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:11.563978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:11.564647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:11.636578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:11.648463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2e780fa3-c077-4f28-849a-77a149ba396d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104251 Nov 10 16:23:11.649211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 957/1949] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:11.985130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:11.986394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:11.994754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:11.995199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:11.995970 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:11.996394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:12.078582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dd5bcde4-73df-4d43-a820-fef24f178fbd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 30191 microversion: 2.1 time: 0.098359 Nov 10 16:23:12.079372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 993/1950] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:11 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 30191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:12.668612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:12.669354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:12.678477 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:12.678921 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:12.679701 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:12.680127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:12.749242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:12.758099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5bebd0eb-30b1-4ece-8cdb-fe584fd84d03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095691 Nov 10 16:23:12.758716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 958/1951] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:13.092025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:13.093286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:13.101250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:13.101700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:13.102521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:13.102963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:13.181346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-54cdf9c4-3cd1-4853-be3b-eec7ae7e2956 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 32131 microversion: 2.1 time: 0.093429 Nov 10 16:23:13.182605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 994/1952] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:13 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 32131 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:13.776650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:13.777267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:13.785051 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:13.785539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:13.786956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:13.787472 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:13.849091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:13.857598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2fa6c492-de90-42cc-aa19-3a8a5fbcfc86 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084761 Nov 10 16:23:13.858187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 959/1953] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:14.198568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:14.199984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:14.209616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:14.210051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:14.210885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:14.211330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:14.286068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-02b059f0-bf43-4507-a21a-603c4e5f6fa3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 33243 microversion: 2.1 time: 0.093817 Nov 10 16:23:14.286784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 995/1954] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:14 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 33243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:14.876570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:14.877862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:14.885521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:14.885984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:14.886972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:14.887690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:14.985411 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:14.994593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1722f13a-378e-4aba-ab86-2339a301d992 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.123183 Nov 10 16:23:14.995185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 960/1955] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:15.299828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:15.300864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:15.308105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:15.308551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:15.309360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:15.309805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:15.385522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44bb1f79-8bed-4301-8f2c-aab664265d4e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 34450 microversion: 2.1 time: 0.090428 Nov 10 16:23:15.386185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 996/1956] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:15 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 34450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:16.020080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:16.021352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:16.032154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:16.032869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:16.034214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:16.034944 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:16.096264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:16.104562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c4311537-17a0-43f0-ba75-d041eb34936a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090895 Nov 10 16:23:16.105157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 961/1957] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:16.403570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:16.404999 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:16.416957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:16.417710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:16.419126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:16.419858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:16.503134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-560b205d-4772-423b-a364-8b47973ca47f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 35902 microversion: 2.1 time: 0.105870 Nov 10 16:23:16.504156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 997/1958] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:16 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 35902 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:17.121282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:17.121962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:17.128994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:17.129436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:17.130301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:17.130731 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:17.191233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:17.199809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-391a3df5-32fb-4638-a8f0-b2361db4c4a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082394 Nov 10 16:23:17.200389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 962/1959] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:17.519460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:17.520650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:17.529353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:17.529885 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:17.530836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:17.531348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:17.619170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2f90b40f-31fb-4970-b984-d0e05b7bf0f4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 37660 microversion: 2.1 time: 0.104403 Nov 10 16:23:17.619841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 998/1960] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:17 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 37660 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:18.225862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:18.226499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:18.233268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:18.233712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:18.234524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:18.234952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:18.296859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:18.305732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d904388c-d324-4b3f-9912-66b2744f8b54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089740 Nov 10 16:23:18.306358 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 963/1961] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:18.636874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:18.638441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:18.648689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:18.649150 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:18.649927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:18.650397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:18.726383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6319a1f1-b51d-4d4c-9c03-a008bf1d9fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 38218 microversion: 2.1 time: 0.096258 Nov 10 16:23:18.727323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 999/1962] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:18 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 38218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:19.325633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:19.326503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:19.335502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:19.335941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:19.336711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:19.337135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:19.398115 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:19.406193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8bf66e88-2323-426d-8fc1-ff6e7e839f5d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085953 Nov 10 16:23:19.406792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 964/1963] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:19.745262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:19.746915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:19.757984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:19.758452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:19.759231 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:19.759655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:19.820315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-69927cba-f4d9-41af-a04b-080c08d48ff3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 38218 microversion: 2.1 time: 0.082143 Nov 10 16:23:19.820944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1000/1964] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:19 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 38218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:20.426072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:20.427127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:20.437679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:20.438428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:20.439459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:20.440178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:20.509287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:20.517332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fdfceb8a-8663-4f93-beb9-3a306754a50d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097271 Nov 10 16:23:20.517909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 965/1965] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:20.837125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:20.838134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:20.845876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:20.846410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:20.847227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:20.847685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:20.912971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b8878250-bde3-41f4-b98f-ea7ad17442fa tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 38218 microversion: 2.1 time: 0.081773 Nov 10 16:23:20.913665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1001/1966] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:20 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 38218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:21.538820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:21.539881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:21.550618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:21.551359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:21.552651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:21.553503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:21.619582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:21.631360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f85eff35-c29b-4581-b0cf-1200cdaf9319 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098526 Nov 10 16:23:21.632068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 966/1967] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:21.931406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:21.932964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:21.944585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:21.945337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:21.946442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:21.946880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:22.025844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ee52ce42-050a-4e9d-9f0d-aa424a180665 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 38271 microversion: 2.1 time: 0.101856 Nov 10 16:23:22.026881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1002/1968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:21 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 38271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:22.658001 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:22.659007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:22.667897 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:22.668348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:22.669131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:22.669564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:22.740716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:22.749072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6f3462fb-fc86-48cb-9b7a-69e16f7462c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097481 Nov 10 16:23:22.749634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 967/1969] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:23.045851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:23.047567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:23.058072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.058553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.059335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.059773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.135172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbb14fa8-28a7-4ae5-9b47-87638a356a51 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 200 len: 38349 microversion: 2.1 time: 0.096274 Nov 10 16:23:23.135834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1003/1970] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:23:23 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 38349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:23:23.145930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:23.146452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:23.153251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.153658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.154453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.154874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.179155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-98ca52e1-0919-4ce4-b6a5-3398ac277aed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/ips" status: 200 len: 146 microversion: 2.1 time: 0.036949 Nov 10 16:23:23.179730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 968/1971] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 16:23:23 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:23:23.770677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:23.771804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:23.780359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.780813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.781598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:23.782032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:23.852505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:23.865503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ea43afa-96fc-4431-aa57-52092a66d1f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101353 Nov 10 16:23:23.866429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1004/1972] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:24.886665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:24.887479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:24.896070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:24.896622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:24.897591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:24.898131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:24.967069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:24.975385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8698f88e-a5b3-4ee3-bdec-30decd8249bf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094390 Nov 10 16:23:24.975958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 969/1973] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:26.000853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:26.002309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:26.012990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:26.013746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:26.015099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:26.015849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:26.080321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:26.088706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-13fafda3-e79e-48f3-8ea7-9e2964366555 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094169 Nov 10 16:23:26.089296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1005/1974] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:27.111797 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:27.112669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:27.119232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:27.119674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:27.120458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:27.120846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:27.183185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:27.196551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9bcafc1-0f8c-4dfe-84e7-0ce714a3ba5c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088545 Nov 10 16:23:27.197136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 970/1975] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:28.213808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:28.214498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:28.221836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:28.222311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:28.223100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:28.223534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:28.288153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:28.296593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f44492c6-934c-4443-b732-97d9d863a6e9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086621 Nov 10 16:23:28.297175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1006/1976] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:29.312994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:29.313639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:29.320458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:29.320900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:29.321716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:29.322152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:29.391353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:29.400239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0efa8a88-9d4c-452e-abca-960f0a3ea929 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090988 Nov 10 16:23:29.400804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 971/1977] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:30.421545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:30.422757 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:30.433286 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:30.433739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:30.434563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:30.435006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:30.506197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:30.514864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2642d4f5-a9e6-48c7-b2a7-e701dd2cca1f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099998 Nov 10 16:23:30.515438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1007/1978] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:31.534794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:31.535762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:31.543630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:31.544077 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:31.544863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:31.545294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:31.606364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:31.614954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-592284b8-9bed-4799-9023-5242209d05ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086411 Nov 10 16:23:31.615499 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 972/1979] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:32.631669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:32.632284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:32.639124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:32.639574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:32.640357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:32.640797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:32.701388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:32.709706 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbf36c88-0950-41c4-9136-0a111ac20041 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.081868 Nov 10 16:23:32.710314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1008/1980] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:33.727535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:33.728391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:33.734947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:33.735385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:33.736150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:33.736581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:33.801766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:33.810501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b8a35465-0755-4820-ac69-ba82bc22ca2c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086647 Nov 10 16:23:33.811111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 973/1981] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:34.828862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:34.829542 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:34.839336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:34.839785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:34.840577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:34.841031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:34.914375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:34.923094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-28e2b06f-34ab-4540-8573-55062e449111 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098526 Nov 10 16:23:34.923673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1009/1982] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:35.943634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:35.944517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:35.952585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:35.953029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:35.953815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:35.954281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:36.252361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:36.260394 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-83b1f748-ef71-4a36-a98f-ef762662165c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.323092 Nov 10 16:23:36.261141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 974/1983] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:37.280369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:37.280997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:37.290860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:37.291414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:37.292561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:37.293090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:37.365764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:37.374073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75971eca-99ea-454e-87f0-6e17571223fc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099839 Nov 10 16:23:37.374612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1010/1984] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:38.400175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:38.401137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:38.408609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:38.409049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:38.409808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:38.410262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:38.479754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:38.488319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c5e3cce6-c3a1-4380-a86f-bf2d8581d88f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094433 Nov 10 16:23:38.488873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 975/1985] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:39.509060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:39.509980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:39.519990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:39.520697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:39.521889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:39.522610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:39.585527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:39.593827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-02b921b2-3e7e-4442-84fe-2568ea136ea7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090602 Nov 10 16:23:39.594545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1011/1986] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:40.615270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:40.616185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:40.627059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:40.627808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:40.629070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:40.629770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:40.704905 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:40.712848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dc5c3e26-f0ea-48db-8fef-d466b57f0728 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104184 Nov 10 16:23:40.713402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 976/1987] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:41.733905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:41.734646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:41.741612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:41.742181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:41.743100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:41.743600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:41.814070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:41.827146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3f9c4cc6-6ca4-4399-ac0e-ce76b7e03eb7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099505 Nov 10 16:23:41.827735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1012/1988] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:42.427753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:42.428229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:42.434641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.435076 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.435877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.436527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.461554 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:23:42.542461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b9bbdf9b-b2a1-4145-bdfb-387d1203e485 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 204 len: 0 microversion: 2.1 time: 0.117738 Nov 10 16:23:42.543030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 977/1989] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:23:42 2021] DELETE /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:23:42.553340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:42.554080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:42.560881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.561348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.562370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.562803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.704383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:42.712462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5131686-23f5-4ffa-be5d-5a1fddada2a3 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1513 microversion: 2.1 time: 0.164343 Nov 10 16:23:42.713062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1013/1990] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:42 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:42.844736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:42.845345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:42.851383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.851829 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.852598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:42.853028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:42.918976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:42.927485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96c0caca-15fb-4b02-b386-db89e31831c5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087316 Nov 10 16:23:42.928157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 978/1991] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:43.452443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-7d3853cb-0b17-4248-8f03-d6bb6afb2960 req-af2c210e-f1cd-4405-b50c-52f35913f762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c27986-b00f-4524-8967-574b878088e8", "name": "network-vif-deleted", "tag": "682b1429-4a27-44a5-835e-1102c9ec680f"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:23:43.454003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:23:43.454003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:23:43.461870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7d3853cb-0b17-4248-8f03-d6bb6afb2960 req-af2c210e-f1cd-4405-b50c-52f35913f762 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.462350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7d3853cb-0b17-4248-8f03-d6bb6afb2960 req-af2c210e-f1cd-4405-b50c-52f35913f762 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:43.475628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-7d3853cb-0b17-4248-8f03-d6bb6afb2960 req-af2c210e-f1cd-4405-b50c-52f35913f762 service nova] Creating event network-vif-deleted:682b1429-4a27-44a5-835e-1102c9ec680f for instance b7c27986-b00f-4524-8967-574b878088e8 on hv-cinder-81708 Nov 10 16:23:43.482058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-7d3853cb-0b17-4248-8f03-d6bb6afb2960 req-af2c210e-f1cd-4405-b50c-52f35913f762 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Nov 10 16:23:43.483114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1014/1992] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:23:43.732071 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:43.732962 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:43.742475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.743106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:43.744199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.744808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:43.777156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.777591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:43.778029 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lazy-loading 'fault' on Instance uuid b7c27986-b00f-4524-8967-574b878088e8 {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:23:43.817643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:43.825107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9edfec8a-2446-4d9b-9cc3-91e2dcf027b6 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 200 len: 1307 microversion: 2.1 time: 0.098619 Nov 10 16:23:43.825658 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 979/1993] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:43 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:43.947545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:43.948294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:43.954685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.955137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:43.955921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:43.956356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:44.018545 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:44.027077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-879e0c49-8241-4d7b-80aa-6ac5e8da6039 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083583 Nov 10 16:23:44.027654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1015/1994] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:44.846198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:44.847151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: b7c27986-b00f-4524-8967-574b878088e8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:44.858380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:44.858832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:44.859615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:44.860052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:44.873518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Instance b7c27986-b00f-4524-8967-574b878088e8 could not be found. Nov 10 16:23:44.874098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 404 to user: Instance b7c27986-b00f-4524-8967-574b878088e8 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:23:44.875038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ec9a9bc3-df48-473d-add4-50323335ec5d tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8" status: 404 len: 111 microversion: 2.1 time: 0.034929 Nov 10 16:23:44.875591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 980/1995] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:44 2021] GET /compute/v2.1/servers/b7c27986-b00f-4524-8967-574b878088e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:23:45.047306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:45.048340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:45.058919 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:45.059671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:45.060957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:45.061567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:45.128836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:45.136887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3bcb85ce-ca38-4d96-aa6a-065074c15549 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095923 Nov 10 16:23:45.137488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1016/1996] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:46.154552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:46.155249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:46.161858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:46.162342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:46.163118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:46.163546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:46.225883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:46.238796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6602bf30-ccd1-49c3-a11e-673faa012b71 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087914 Nov 10 16:23:46.239383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 981/1997] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:47.256140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:47.256738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:47.263408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:47.264575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:47.265384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:47.265831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:47.325905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:47.334513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-61930174-46a0-4a14-9eb1-0468866b915a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082174 Nov 10 16:23:47.335422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1017/1998] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:48.355980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:48.356952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:48.364302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:48.364743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:48.365508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:48.365944 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:48.436329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:48.447275 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1200266a-0a21-40de-aafe-9b7de95bbe9e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097371 Nov 10 16:23:48.448007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 982/1999] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:49.467019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:49.468001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:49.474566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:49.475015 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:49.475807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:49.476242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:49.538065 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:49.546640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2316f62d-617c-488a-9dcf-7e9fce074275 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084409 Nov 10 16:23:49.547221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1018/2000] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:50.572342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:50.573229 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:50.581372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:50.581823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:50.582636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:50.583062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:50.651981 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:50.660374 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7ce9b955-d32b-4de4-93f0-76071e4f6b91 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094561 Nov 10 16:23:50.660944 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 983/2001] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:51.680051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:51.680722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:51.689601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:51.690053 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:51.690887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:51.691313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:51.757163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:51.767575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a1347e4f-7af9-427e-be07-c49aadd4f3f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093615 Nov 10 16:23:51.768151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1019/2002] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:52.791853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:52.792830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:52.802539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:52.803102 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:52.804149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:52.804676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:52.878670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:52.886796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a8ce46ea-dda0-4a12-ae22-3ae2c27b39a7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104371 Nov 10 16:23:52.887356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 984/2003] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:53.903984 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:53.904729 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:53.911495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:53.911960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:53.912749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:53.913198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:53.974485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:53.983127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7d857139-7ff7-44f7-9c2c-2989b8160395 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082938 Nov 10 16:23:53.983741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1020/2004] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:55.003309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:55.003988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:55.014519 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:55.015085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:55.016230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:55.016908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:55.078196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:55.086932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3e596ef2-d0c7-4ef7-8570-8fddcdb55761 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090078 Nov 10 16:23:55.087504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 985/2005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:56.108497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:56.109471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:56.120627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:56.121389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:56.122812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:56.123543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:56.186453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:56.195135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e1fbfb8c-43c7-485d-b6e1-0f70f9b915de tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092948 Nov 10 16:23:56.195715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1021/2006] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:57.213255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:57.213850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:57.220842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:57.221294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:57.222079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:57.222542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:57.291972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:57.300582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-98f1e82d-4acf-4faf-aa11-27d00849bab9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091206 Nov 10 16:23:57.301153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 986/2007] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:58.321433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:58.322038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:58.329031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:58.329485 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:58.330303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:58.330861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:58.395937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:58.404531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-590aa357-67c2-4b90-af46-a56b6e10c466 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089005 Nov 10 16:23:58.405146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1022/2008] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:23:59.424158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:23:59.424911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:23:59.432928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:59.433378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:59.434153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:23:59.434623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:23:59.501710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:23:59.512908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2a5d1c04-1f6b-4a83-8967-f11bf23f5ff5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093663 Nov 10 16:23:59.513646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 987/2009] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:23:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:00.535120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:00.536021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:00.543962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:00.544415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:00.545204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:00.545642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:00.614773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:00.623566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-48221fe0-3433-40b8-83c8-628d3625669f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095157 Nov 10 16:24:00.624144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1023/2010] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:01.648569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:01.649286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:01.656055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:01.656520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:01.657268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:01.657690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:01.723801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:01.736532 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bac654ef-8f0f-4a4e-b5da-5887f6626b4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094420 Nov 10 16:24:01.737321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 988/2011] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:02.758184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:02.758822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:02.766480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:02.766935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:02.767709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:02.768136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:02.829340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:02.837661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4eca1ac6-ce7a-4e01-a993-5d7c9fa08bc2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085571 Nov 10 16:24:02.838280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1024/2012] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:03.859425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:03.860565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:03.869928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:03.870527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:03.871362 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:03.871804 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:03.932630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:03.941044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f43e7de9-a600-4ed8-8ac6-1d6fd3f86a7e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088016 Nov 10 16:24:03.941624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 989/2013] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:04.962590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:04.963555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:04.974572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:04.975336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:04.976569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:04.977005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:05.048078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:05.057050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0ff2c18e-ed77-464b-a8d5-510acbfab71d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100827 Nov 10 16:24:05.057641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1025/2014] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:06.074813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:06.075429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:06.082397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:06.082844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:06.083631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:06.084058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:06.146711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:06.155063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d68eb619-6e20-4103-883f-6cbf6d594bf9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083997 Nov 10 16:24:06.155641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 990/2015] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:07.172046 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:07.172683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:07.179652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:07.180107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:07.180896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:07.181336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:07.244013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:07.252689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e2a201ec-c518-4dd9-80e7-3a955c2c68aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084568 Nov 10 16:24:07.253272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1026/2016] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:08.269107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:08.269732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:08.276578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:08.277023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:08.277793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:08.278258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:08.341068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:08.349526 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bc505dc8-2cab-45a2-a300-6d3ba610cc24 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084243 Nov 10 16:24:08.350108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 991/2017] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:09.372490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:09.373106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:09.380875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:09.381372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:09.382292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:09.382939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:09.444644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:09.453194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1c36c5d3-60ab-4c26-a6b2-e761b9925e03 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084686 Nov 10 16:24:09.453777 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1027/2018] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:10.472079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:10.472899 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:10.480164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:10.480629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:10.481381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:10.481807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:10.551044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:10.559346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f6b76f78-3af4-420b-99b2-f664518868d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092267 Nov 10 16:24:10.559911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 992/2019] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:11.576744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:11.577454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:11.583746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:11.584193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:11.584956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:11.585394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:11.655199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:11.665192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e3728d3f-6857-4039-8d9d-3aeef6f39098 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092206 Nov 10 16:24:11.665973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1028/2020] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:12.687733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:12.688356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:12.695142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:12.695573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:12.696355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:12.696780 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:12.759933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:12.772710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0a016ed4-def8-4ac8-9fa4-919e6e3564cf tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088371 Nov 10 16:24:12.773406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 993/2021] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:13.795974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:13.796974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:13.806816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:13.807273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:13.808068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:13.808512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:13.869271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:13.878052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-dd1c081c-ebab-46e7-8b37-8c3a8fb07af5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089275 Nov 10 16:24:13.878740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1029/2022] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:14.899114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:14.899812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:14.907277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:14.907710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:14.908490 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:14.908928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:14.983812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:14.993336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-10997c09-1e2f-450e-bd9f-aa47609c052f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099098 Nov 10 16:24:14.993930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 994/2023] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:16.010711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:16.011297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:16.018303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:16.018765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:16.019553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:16.019990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:16.080359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:16.088902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0975de79-d373-47c7-9042-d2416f7234dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082014 Nov 10 16:24:16.089496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1030/2024] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:17.112552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:17.113712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:17.120877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:17.121308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:17.122095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:17.122555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:17.198323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:17.209181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5dabbac9-8486-47ef-bd48-20bb389ba282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101384 Nov 10 16:24:17.209736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 995/2025] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:18.226429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:18.227198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:18.234075 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:18.234559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:18.235344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:18.235778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:18.301951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:18.310688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3030370e-8f20-4c5f-8e2e-39039d81e441 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088221 Nov 10 16:24:18.311260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1031/2026] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:19.328659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:19.329263 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:19.336157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:19.336595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:19.337366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:19.337796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:19.405414 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:19.418505 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-41d2f984-0659-47c2-a058-8a9fbf550a87 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093657 Nov 10 16:24:19.419801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 996/2027] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:20.441135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:20.442116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:20.452814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:20.453567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:20.454922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:20.455653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:20.522747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:20.532534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b061d03e-053a-4488-b895-8f5c5252a0a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097633 Nov 10 16:24:20.533147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1032/2028] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:21.549763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:21.550531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:21.557079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:21.557596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:21.558426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:21.558859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:21.619319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:21.628125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3bfc2ef-eb46-48c5-b5b9-763a4940f172 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082223 Nov 10 16:24:21.628694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 997/2029] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:22.644880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:22.645605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:22.652380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:22.652991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:22.653761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:22.655732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:22.714758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:22.722893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5ad37193-3f9e-4dc4-9940-93f5c47c8c26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.081892 Nov 10 16:24:22.723438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1033/2030] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:23.745155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:23.746107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:23.757369 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:23.758112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:23.759435 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:23.760163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:23.823267 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:23.831440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f8008355-be95-4d1a-a4ad-030a9b6a7f8b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092856 Nov 10 16:24:23.832006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 998/2031] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:24.857779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:24.859059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:24.870017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:24.870788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:24.872089 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:24.872805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:24.948678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:24.961232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f935d7c7-0448-421f-beb8-312de7a8f084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.109545 Nov 10 16:24:24.962044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1034/2032] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:25.984158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:25.984919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:25.993069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:25.993622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:25.994772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:25.995322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:26.065007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:26.073183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-61d84860-7797-4e00-920e-6294ea1e048f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094975 Nov 10 16:24:26.073748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 999/2033] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:27.093600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:27.094275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:27.101047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:27.101505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:27.102385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:27.102734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:27.166377 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:27.174799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ca451cd-c579-4e4e-b58f-52d144e130ab tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086569 Nov 10 16:24:27.175423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1035/2034] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:28.195742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:28.196726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:28.205365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:28.205800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:28.206600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:28.207023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:28.269205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:28.281677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ffb7eabd-c498-41b3-b1fc-6f4ad4cb4522 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091922 Nov 10 16:24:28.282487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1000/2035] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:29.299801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:29.300386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:29.307422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:29.307864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:29.308637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:29.309058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:29.385244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:29.397530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b72cf949-7d93-40be-8f56-71eca4be1ef5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101139 Nov 10 16:24:29.398458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1036/2036] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:30.418608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:30.419542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:30.426873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:30.427313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:30.428080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:30.428481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:30.491090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:30.503421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0dc938f3-2dbf-446f-93fa-7bd9e0918fbc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090679 Nov 10 16:24:30.504210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1001/2037] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:31.524937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:31.525629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:31.533327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:31.533780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:31.534607 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:31.535035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:31.610929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:31.623094 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-00e64ced-8114-4a93-8b3b-7fed03b4b2a1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.102098 Nov 10 16:24:31.623838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1037/2038] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:32.643169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:32.643957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:32.652660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:32.653256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:32.654344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:32.654957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:32.729116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:32.737799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ba18c010-94f3-4c70-9b5b-f7402be3c669 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100365 Nov 10 16:24:32.738430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1002/2039] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:33.759408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:33.760395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:33.771759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:33.772517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:33.773794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:33.774558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:33.837163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:33.845560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-85899973-09e6-4c38-a42d-13d95e1b1723 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092347 Nov 10 16:24:33.846143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1038/2040] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:34.865091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:34.865904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:34.874201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:34.874791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:34.876082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:34.876620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:34.947194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:34.955330 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-062e9f17-5772-4ff5-928f-8285e9980242 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095623 Nov 10 16:24:34.955879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1003/2041] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:35.974858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:35.975574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:35.983718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:35.984279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:35.985229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:35.985764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:36.051189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:36.059246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a49c7d97-32b0-4c8c-90e7-e1bc03495d44 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089483 Nov 10 16:24:36.059805 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1039/2042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:37.079544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:37.080611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:37.087630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:37.088067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:37.088841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:37.089257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:37.153131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:37.161963 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b1342de4-b6fc-45a7-a4df-b57885eb63e2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088720 Nov 10 16:24:37.162595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1004/2043] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:38.182022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:38.182989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:38.192378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:38.192830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:38.193621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:38.194059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:38.269550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:38.278602 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac7e2fa9-24b8-4179-a060-6c2f34983ad9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.102340 Nov 10 16:24:38.279223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1040/2044] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:39.296359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:39.296978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:39.303855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:39.304296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:39.305079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:39.305507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:39.366591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:39.374785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7fe4fa7e-4a5c-4a5e-abe5-a8f21359ecc0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082496 Nov 10 16:24:39.375690 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1005/2045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:40.393056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:40.393695 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:40.402741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:40.404306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:40.405475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:40.406002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:40.479305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:40.487989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-38a083a5-fb84-4238-a32c-37952264f178 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098732 Nov 10 16:24:40.488557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1041/2046] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:41.514714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:41.515694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:41.523373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:41.523811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:41.524581 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:41.525018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:41.591913 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:41.600384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d412ef12-8fc4-469d-a44d-f935dcabcd27 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092220 Nov 10 16:24:41.600961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1006/2047] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:42.622497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:42.623400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:42.631812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:42.632252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:42.633057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:42.633483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:42.705190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:42.714371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-be1f7b63-d9f2-4804-9cf7-3b4365ff8af1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098208 Nov 10 16:24:42.714946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1042/2048] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:43.735747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:43.737069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:43.744022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:43.744475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:43.745248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:43.745675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:43.813764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:43.823193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e4c8d67a-d007-4a24-a718-88cd36656084 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093971 Nov 10 16:24:43.823769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1007/2049] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:44.844149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:44.845159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:44.852665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:44.853110 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:44.853873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:44.854336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:44.921988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:44.930439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a5e42ae3-0ae3-4a24-a3a1-baf46796a342 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092502 Nov 10 16:24:44.931019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1043/2050] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:45.948380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:45.949168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:45.957232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:45.957752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:45.958707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:45.959260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:46.030461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:46.038862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-efa3d7c1-0372-4c56-990b-f0d67b8d6c47 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094927 Nov 10 16:24:46.039429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1008/2051] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:47.059496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:47.060436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:47.071395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:47.072005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:47.073144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:47.073717 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:47.162193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:47.170833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b303b8d3-35f2-449a-982e-bff7c1a7fe75 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.117491 Nov 10 16:24:47.171410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1044/2052] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:48.191747 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:48.192739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:48.204426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:48.205165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:48.206515 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:48.207227 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:48.271984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:48.280187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dbb4bc21-dfa2-42a5-9a70-0385391f4fe6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094749 Nov 10 16:24:48.280778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1009/2053] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:49.297255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:49.297858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:49.304866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:49.305316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:49.306090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:49.306556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:49.367923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:49.376781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f98bb6f9-28a4-47e3-9fcf-d8f4951bd1e5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083230 Nov 10 16:24:49.377362 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1045/2054] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:50.396904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:50.397534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:50.404438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:50.404869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:50.405632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:50.406053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:50.468106 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:50.480628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5f4dd509-f061-43ae-9a18-1341adfe3347 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089403 Nov 10 16:24:50.481467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1010/2055] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:51.502236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:51.502870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:51.509550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:51.509995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:51.510799 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:51.511238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:51.581739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:51.589976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-41412a9a-2712-4c26-bee4-33a4325fd1f0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091828 Nov 10 16:24:51.590603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1046/2056] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:52.610954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:52.611617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:52.619729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:52.620176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:52.620948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:52.621373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:52.689585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:52.698114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-91ada1ad-784f-4b40-8cef-b97a4de99005 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093472 Nov 10 16:24:52.698724 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1011/2057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:53.718962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:53.719925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:53.728510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:53.728963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:53.729746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:53.730184 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:53.792327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:53.800846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a5a52304-13db-4aac-b967-338049f1fe21 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088140 Nov 10 16:24:53.801442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1047/2058] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:54.822501 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:54.824161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:54.835560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:54.836270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:54.837034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:54.837458 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:54.908955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:54.921101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8d9bc78d-3541-4daf-9b4e-cec4d4f14153 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.106601 Nov 10 16:24:54.921742 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1012/2059] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:55.944561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:55.945605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:55.952893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:55.953340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:55.954120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:55.954570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:56.028995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:56.037350 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-90b40ec7-c103-4ab9-a358-2442b1302b26 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098907 Nov 10 16:24:56.037912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1048/2060] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:57.183967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:57.184551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:57.190971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:57.191415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:57.192198 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:57.192623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:57.258693 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:57.267430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bf42559f-15d5-47ba-bcc1-79bb3d7dad85 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.216420 Nov 10 16:24:57.267999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1013/2061] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:57.359546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:24:57.360174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:24:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:24:58.284624 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:58.285239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:58.292553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:58.293017 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:58.293824 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:58.294291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:58.361442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:58.373850 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6ab05cd0-74b4-408b-8d26-0c10ff89fd1e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092767 Nov 10 16:24:58.375215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1049/2062] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:24:59.395092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:24:59.395734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:24:59.402738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:59.403183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:59.403935 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:24:59.404397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:24:59.473865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:24:59.484218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-81097eb4-b200-4f32-9c46-ef4591075189 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092592 Nov 10 16:24:59.485105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1014/2063] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:24:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:00.508546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:00.509585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:00.516916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:00.517372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:00.518183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:00.518626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:00.586762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:00.595210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8b19fa83-e751-44ac-9e40-fe6c75ddfe6f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093240 Nov 10 16:25:00.595786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1050/2064] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:01.615579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:01.616404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:01.623703 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:01.624151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:01.625244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:01.625671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:01.687327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:01.695474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ad0e719a-7b77-4ab6-8433-98c538c92ed4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086090 Nov 10 16:25:01.696042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1015/2065] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:02.715800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:02.716736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:02.727764 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:02.728327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:02.729140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:02.729577 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:02.792923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:02.801036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3ffcc142-a761-4eca-9af4-4b7d2464361c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091664 Nov 10 16:25:02.801635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1051/2066] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:03.821861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:03.823116 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:03.833741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:03.834549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:03.835823 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:03.836535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:03.906113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:03.916765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c11baf1c-a049-455f-ba4e-d4913c496ed9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100702 Nov 10 16:25:03.917535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1016/2067] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:04.938361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:04.939130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:04.949937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:04.950298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:04.951119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:04.951580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:05.022581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:05.035499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7ab84fd0-82cc-4aea-a96e-b1b0e7e80e4c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101489 Nov 10 16:25:05.036381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1052/2068] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:06.055774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:06.056966 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:06.063491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:06.063930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:06.064725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:06.065185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:06.131085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:06.139238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d858f26f-bcac-4230-98e3-e3a728131d17 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088318 Nov 10 16:25:06.139801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1017/2069] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:07.156560 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:07.157232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:07.164213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:07.164660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:07.165515 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:07.166516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:07.237732 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:07.246496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ab4273db-7ab9-4843-b845-d95031b36014 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094122 Nov 10 16:25:07.247070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1053/2070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:08.266715 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:08.267305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:08.276600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:08.277052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:08.277835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:08.278315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:08.348165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:08.360274 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-40c85060-d3a4-4fe6-bffe-468321262c0e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099601 Nov 10 16:25:08.360948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1018/2071] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:09.381285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:09.382299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:09.390022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:09.390490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:09.391327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:09.391761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:09.458727 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:09.467516 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b6e863e0-1264-491e-a2a1-8f42ca5fae54 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092305 Nov 10 16:25:09.468082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1054/2072] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:10.488741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:10.489722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:10.497854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:10.498259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:10.499032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:10.499811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:10.568385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:10.576970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-025e2989-a128-4d5b-8459-98ad88562324 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094778 Nov 10 16:25:10.577567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1019/2073] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:11.005211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:25:11.006260 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:25:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:25:11.593937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:11.594576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:11.601127 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:11.601539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:11.602344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:11.602912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:11.686981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:11.698216 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9fcd15a8-ab22-45cf-9e51-0e2fce7d152d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.108080 Nov 10 16:25:11.698809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1055/2074] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:12.719883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:12.720775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:12.730415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:12.730853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:12.731635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:12.732059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:12.793878 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:12.802242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-603f67a2-0e42-4a08-b47c-a614bd4e5a4b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089513 Nov 10 16:25:12.802801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1020/2075] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:13.823981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:13.824971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:13.835911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:13.836685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:13.838946 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:13.839390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:13.901838 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:13.910040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75bee1a9-d797-41ac-845b-6e0705e0d9b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093105 Nov 10 16:25:13.910640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1056/2076] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:25:14.926906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:14.927541 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:14.934199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:14.934674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:14.935471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:14.935902 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:15.009873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:15.028112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0f20dbdf-f362-4a71-9d9a-d3a0cb01a008 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104931 Nov 10 16:25:15.028689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1021/2077] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:16.045800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:16.046761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:16.054581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:16.055061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:16.055854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:16.056292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:16.139853 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:16.148319 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ffd50249-b308-4638-af6f-3f678e09245a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.107046 Nov 10 16:25:16.148923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1057/2078] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:16 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:17.168417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:17.169055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:17.175923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:17.176342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:17.177117 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:17.177540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:17.251489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:17.260098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-554a1d2a-6dd2-48f2-9e92-63f34a9d14dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098526 Nov 10 16:25:17.260661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1022/2079] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:18.277832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:18.278497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:18.285318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:18.285762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:18.286567 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:18.286995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:18.350779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:18.359494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2afbb696-f634-45b1-a005-7477d7853af2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085648 Nov 10 16:25:18.360058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1058/2080] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:19.378218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:19.378950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:19.387159 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:19.387600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:19.388388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:19.388841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:19.454568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:19.462626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-738c8cae-6094-4786-9dd8-e170ade6b85c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089510 Nov 10 16:25:19.463191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1023/2081] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:20.480709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:20.481475 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:20.491665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:20.492478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:20.493874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:20.494694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:20.571647 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:20.580066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-77d5e571-9d18-430a-a49c-9ab2a391fd95 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.103554 Nov 10 16:25:20.580633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1059/2082] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:21.601596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:21.602254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:21.609247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:21.609689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:21.610552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:21.610979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:21.680282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:21.688687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fba8d56a-ce23-4cb1-ab1a-1cb8548e1fc4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090912 Nov 10 16:25:21.689264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1024/2083] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:22.705552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:22.706331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:22.712907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:22.713351 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:22.714121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:22.714584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:22.777580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:22.787135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3d535ff3-f303-4989-98d0-249dab9f664d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085377 Nov 10 16:25:22.794329 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1060/2084] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:23.804380 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:23.805016 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:23.811876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:23.812318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:23.813092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:23.813517 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:23.879180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:23.890692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-67a87533-2bf7-45fd-b3d2-bcfcc30d73ce tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090055 Nov 10 16:25:23.891279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1025/2085] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:24.910187 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:24.910954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:24.919309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:24.919860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:24.920964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:24.921613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:24.986287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:24.994743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6f44fcce-399f-4efe-bac4-629f40504aec tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089329 Nov 10 16:25:24.995291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1061/2086] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:26.018195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:26.018838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:26.025682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:26.026125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:26.026918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:26.027337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:26.092187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:26.101886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9b8f29c-5421-43ab-baa3-f77a35b0e0b2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088003 Nov 10 16:25:26.102510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1026/2087] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:27.122760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:27.124214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:27.133210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:27.133657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:27.134492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:27.134922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:27.197481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:27.208449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-59d625c5-a09c-4950-a62a-447d0423530e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091904 Nov 10 16:25:27.209038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1062/2088] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:28.230953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:28.231611 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:28.238521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:28.238954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:28.239717 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:28.240138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:28.306820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:28.318092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6898ef7b-5cd2-4a94-9429-b084b7c451b9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090705 Nov 10 16:25:28.318900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1027/2089] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:29.343927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:29.344525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:29.353183 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:29.353783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:29.354934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:29.355594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:29.430723 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:29.441602 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-31a5ad84-e124-469a-852b-fb572607f518 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.103652 Nov 10 16:25:29.442107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1063/2090] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:30.462914 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:30.463841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:30.475451 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:30.476193 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:30.477473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:30.478256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:30.554137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:30.566400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-812fe0da-b60e-4c0e-9f4d-9cbfcebef54f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.110096 Nov 10 16:25:30.566959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1028/2091] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:31.590361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:31.591095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:31.598816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:31.599266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:31.600035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:31.600468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:31.671302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:31.680557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9a32a82e-888d-4dec-aa2c-193602597532 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096709 Nov 10 16:25:31.681141 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1064/2092] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:32.701854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:32.702858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:32.709973 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:32.710491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:32.711271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:32.711699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:32.779842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:32.793285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-024ee7ff-86cf-407c-8652-6623394d4edd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097633 Nov 10 16:25:32.794042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1029/2093] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:33.812578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:33.813465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:33.820527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:33.820982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:33.821768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:33.822188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:33.890080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:33.898801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3593cf46-7529-420d-b63b-36f06b03828b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091065 Nov 10 16:25:33.899369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1065/2094] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:34.919288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:34.920279 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:34.928555 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:34.929003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:34.929760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:34.930192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:34.999404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:35.007692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7041625b-826e-4fc3-b3c0-9969820569dc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094589 Nov 10 16:25:35.008248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1030/2095] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:36.032834 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:36.033874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:36.040820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:36.041259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:36.042030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:36.042490 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:36.110791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:36.119641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d34aff90-c19f-49bc-b8bc-de16ee39a31d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093096 Nov 10 16:25:36.120212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1066/2096] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:37.138872 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:37.139716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:37.147447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:37.147888 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:37.148649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:37.149082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:37.214187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:37.224316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ceccca28-8125-428d-a9f6-af303cac68ef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090384 Nov 10 16:25:37.225185 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1031/2097] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:38.241367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:38.242020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:38.249339 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:38.249787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:38.250612 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:38.251047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:38.313787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:38.322863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-de1aeb4d-8187-4721-a825-c0614e51f1a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085533 Nov 10 16:25:38.323440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1067/2098] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:39.342412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:39.343242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:39.352688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:39.353672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:39.354775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:39.355360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:39.421044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:39.430760 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e04846f-e565-4ac5-af53-c9e6779e1bee tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093479 Nov 10 16:25:39.431338 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1032/2099] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:40.449481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:40.450327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:40.459812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:40.460415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:40.461430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:40.462006 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:40.529118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:40.537899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2ec1a07b-eba3-40f1-aaef-94e4f25c353f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093585 Nov 10 16:25:40.538506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1068/2100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:41.556381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:41.557140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:41.565135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:41.565865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:41.566753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:41.567296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:41.633063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:41.641261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1644e88f-637e-4ed5-9dd1-dbc0585f4f14 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089700 Nov 10 16:25:41.641834 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1033/2101] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:42.662548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:42.663340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:42.671976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:42.672586 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:42.673613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:42.674207 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:42.739738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:42.748114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d9d19118-dafd-4066-96ca-b0c528465643 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091872 Nov 10 16:25:42.749599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1069/2102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:43.769719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:43.770805 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:43.778130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:43.778633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:43.779452 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:43.779906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:43.844544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:43.853073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3ad17479-b767-42c6-9786-faad02a47b35 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089480 Nov 10 16:25:43.853661 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1034/2103] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:44.878561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:44.879528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:44.887084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:44.887538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:44.888384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:44.888752 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:44.951136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:44.962493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2356d35c-c35b-4699-aefc-2ca4430f1b09 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090580 Nov 10 16:25:44.963081 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1070/2104] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:45.981846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:45.982881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:45.990959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:45.991512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:45.992367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:45.992786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:46.054506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:46.064923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6685cb8e-fb1b-4a76-a65e-0f5f28c9851d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088249 Nov 10 16:25:46.065494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1035/2105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:45 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:47.086083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:47.087115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:47.098061 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:47.098877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:47.100290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:47.101022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:47.172746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:47.180975 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-208c5a1d-ac82-440f-9105-8467dac52773 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101258 Nov 10 16:25:47.181580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1071/2106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:48.202196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:48.203213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:48.213286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:48.213740 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:48.214582 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:48.215014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:48.276360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:48.284737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dbfabed2-1c5d-4baa-b3f7-54512ff2fa84 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088911 Nov 10 16:25:48.285272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1036/2107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:49.302478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:49.303107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:49.309992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:49.310474 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:49.311248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:49.311690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:49.375921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:49.383835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6b7a589f-5223-4405-b7bf-711ba072532d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085312 Nov 10 16:25:49.384398 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1072/2108] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:50.403381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:50.404125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:50.412317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:50.412868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:50.413844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:50.414520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:50.481177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:50.489174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c1ce7572-0807-48e7-a8d7-d68e92509f73 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090924 Nov 10 16:25:50.489739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1037/2109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:51.509933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:51.510608 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:51.518039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:51.518524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:51.519298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:51.519740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:51.585214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:51.593360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-63fd5d0a-6bd6-4557-8f7e-71ed62b749e3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089250 Nov 10 16:25:51.593929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1073/2110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:52.614530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:52.615471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:52.624254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:52.624695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:52.625479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:52.625909 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:52.695342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:52.703616 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c2458d10-6cd4-4fdb-b51f-a27cdd7dd590 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095716 Nov 10 16:25:52.704171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1038/2111] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:53.724306 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:53.725369 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:53.733198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:53.733655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:53.734472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:53.734914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:53.806347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:53.814543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0cbe60bd-f573-4576-b699-422be8f63cfa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096500 Nov 10 16:25:53.815114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1074/2112] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:54.835035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:54.835942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:54.843281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:54.843711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:54.844471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:54.844890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:54.913811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:54.922307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6731fc51-31e0-4633-b57c-63e049d8b21a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093478 Nov 10 16:25:54.922866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1039/2113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:55.943555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:55.944572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:55.952553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:55.953025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:55.953806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:55.954271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:56.019422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:56.031972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-664c765d-6654-41d4-afcc-c3fce5b6357b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094652 Nov 10 16:25:56.032553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1075/2114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:55 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:57.055763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:57.056776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:57.063915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:57.064381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:57.065225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:57.065682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:57.132038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:57.140649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4f2638ef-f6f9-4dc1-99f2-3ad61d43ddc5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091120 Nov 10 16:25:57.141235 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1040/2115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:58.159967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:58.160748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:58.168565 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:58.169087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:58.169913 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:58.170420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:58.239762 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:58.248746 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2ede274d-d2c6-4ec5-bf9a-0844dafe41d1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093098 Nov 10 16:25:58.249353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1076/2116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:25:59.268999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:25:59.269606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:25:59.276626 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:59.277069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:59.277833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:25:59.278297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:25:59.348715 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:25:59.357000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7cac5b3d-b201-4a92-a563-4b00fcdd9fef tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091766 Nov 10 16:25:59.357558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1041/2117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:25:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:00.378859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:00.379922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:00.388861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:00.390479 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:00.391284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:00.392336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:00.461167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:00.469801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3fe83543-2001-45e8-a9e8-0ae2971fa274 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097832 Nov 10 16:26:00.470426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1077/2118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:01.493994 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:01.495014 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:01.501904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:01.502388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:01.503160 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:01.503593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:01.570975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:01.585146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e08dab22-9c89-4509-b3f6-39b8efb4dfcd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097028 Nov 10 16:26:01.586309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1042/2119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:02.608733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:02.609413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:02.616937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:02.617437 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:02.618359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:02.618845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:02.693964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:02.702940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8f478382-0f47-4bc7-b3b6-ddf4680869d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098937 Nov 10 16:26:02.703509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1078/2120] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:03.722424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:03.723287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:03.732738 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:03.733365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:03.734568 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:03.735181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:03.815510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:03.828000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-76a8f2b4-2a5c-4512-8285-cdc503839b22 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.110633 Nov 10 16:26:03.828891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1043/2121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:04.852899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:04.854031 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:04.861215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:04.861654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:04.862469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:04.862889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:04.932399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:04.940524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75af7cef-765f-429b-b113-f537a69a65fb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094064 Nov 10 16:26:04.941121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1079/2122] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:05.961134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:05.962289 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:05.970195 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:05.970649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:05.971432 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:05.971868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:06.036901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:06.045908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-52ebe7d1-f45c-4148-a642-b75a88733c3e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090886 Nov 10 16:26:06.046503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1044/2123] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:05 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:07.067749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:07.068683 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:07.077617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:07.078071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:07.078890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:07.079328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:07.146077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:07.159740 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b5e7bfb0-6e41-4145-a42b-2b911c5d89da tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098639 Nov 10 16:26:07.160576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1080/2124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:08.176948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:08.177557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:08.184528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:08.184969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:08.185788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:08.186239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:08.245210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:08.253590 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-15867d09-b6de-4528-a832-17e2c5d305e1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.080335 Nov 10 16:26:08.254199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1045/2125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:09.271457 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:09.272074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:09.279887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:09.280342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:09.281122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:09.281555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:09.344618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:09.353198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-15d28bbd-c670-46ea-93e9-3012108842a5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085885 Nov 10 16:26:09.353766 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1081/2126] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:10.375459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:10.376379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:10.386604 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:10.387040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:10.387803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:10.388222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:10.458735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:10.469266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4c647619-3414-43f0-93fd-ffd626d68203 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101576 Nov 10 16:26:10.469840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1046/2127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:11.487123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:11.487747 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:11.494539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:11.494986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:11.496056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:11.496510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:11.560215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:11.571060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2e6dc38d-7c3f-4f1a-8f74-f45e1d5af8c4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087637 Nov 10 16:26:11.571633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1082/2128] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:12.591399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:12.592280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:12.603041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:12.603813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:12.605100 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:12.605533 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:12.679066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:12.688607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-55e4a0aa-e82b-460d-b987-bcfb0ee389b4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.103497 Nov 10 16:26:12.689192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1047/2129] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:13.709590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:13.710720 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:13.719358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:13.719813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:13.720593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:13.721030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:13.785955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:13.795900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0a9363d9-7ed7-4e69-9500-a494bc2ff803 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092678 Nov 10 16:26:13.796456 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1083/2130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:14.816917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:14.817855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:14.826755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:14.827194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:14.827920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:14.828376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:14.889332 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:14.897371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e3038c54-77e1-4505-b863-c17ccf9a4a01 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086594 Nov 10 16:26:14.897942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1048/2131] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:15.915082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:15.915735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:15.922772 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:15.923224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:15.924008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:15.924659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:15.991932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:16.005400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9acedfd2-9458-46ac-9b39-8ba99ec34731 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094175 Nov 10 16:26:16.005985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1084/2132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:17.027989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:17.028778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:17.040156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:17.041086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:17.042665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:17.043219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:17.107889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:17.117154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f5ded1ee-b900-4598-9327-7123df96039b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095228 Nov 10 16:26:17.117757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1049/2133] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:18.139468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:18.140111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:18.146901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:18.147356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:18.148175 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:18.148596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:18.216126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:18.228781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-adc2b57c-7d2c-46ae-845e-3253c84052f9 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092803 Nov 10 16:26:18.229544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1085/2134] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:19.246727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:19.247196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:19.254345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:19.254792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:19.255887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:19.256307 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:19.318750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:19.327004 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-51969fa4-d951-4363-a7dc-bb11bb457963 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084372 Nov 10 16:26:19.327569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1050/2135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:20.348337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:20.349320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:20.361177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:20.361961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:20.363343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:20.364200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:20.447042 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:20.458843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1503d74e-5c60-42e8-9a31-4c3fa008c21b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.116549 Nov 10 16:26:20.459614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1086/2136] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:21.480258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:21.481107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:21.487511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:21.487948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:21.488713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:21.489147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:21.549390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:21.558031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-de9d8b33-d1cc-4f97-b164-ed2df49d2972 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083680 Nov 10 16:26:21.558643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1051/2137] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:22.578032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:22.578907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:22.589266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:22.589715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:22.590552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:22.590988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:22.662501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:22.670418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4d16a2d4-4506-48cc-b028-f4f95f91522d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098337 Nov 10 16:26:22.670986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1087/2138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:23.694815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:23.695558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:23.703199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:23.703648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:23.704402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:23.704830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:23.778258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:23.786243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0457df6b-dc3d-4220-87f6-1def606155d2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097731 Nov 10 16:26:23.786789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1052/2139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:23 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:24.807312 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:24.808452 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:24.815271 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:24.815718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:24.816502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:24.816937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:24.881635 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:24.890095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d421bdab-a804-4394-bb7e-f5b46c8cfbd8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089137 Nov 10 16:26:24.890719 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1088/2140] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:25.395397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:26:25.396291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:26:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:26:25.907692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:25.908459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:25.916138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:25.916662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:25.917792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:25.918258 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:25.978105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:25.986770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2db183cc-ab13-4ffb-9a3b-2a08ab0593dd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083463 Nov 10 16:26:25.987323 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1053/2141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:27.007771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:27.008741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:27.019630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:27.020387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:27.021658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:27.022432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:27.251361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:27.260019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-897eb65c-9239-4c03-b1ad-af359b5892f1 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.258352 Nov 10 16:26:27.260526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1089/2142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:28.277190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:28.277809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:28.284546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:28.284990 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:28.285754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:28.286150 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:28.349564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:28.357529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-65919bb4-7656-4ebd-9f48-122548b5ffe5 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084061 Nov 10 16:26:28.358108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1054/2143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:29.378224 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:29.379204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:29.390093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:29.390877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:29.392156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:29.392907 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:29.457164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:29.465324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cc5eee99-0ef3-451a-8af7-18fa5db5635e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093809 Nov 10 16:26:29.465904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1090/2144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:30.485592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:30.486579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:30.496260 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:30.496978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:30.498681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:30.499223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:30.567249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:30.576087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3a845ecc-91cc-460a-bc24-2e322d15dc36 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096481 Nov 10 16:26:30.576662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1055/2145] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:31.594912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:31.595575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:31.602396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:31.602870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:31.603642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:31.604076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:31.665100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:31.673817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8ed28730-1dd4-4250-9efc-6e20041799c3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083283 Nov 10 16:26:31.674443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1091/2146] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:32.698111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:32.700923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:32.706965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:32.706965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:32.706965 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:32.707434 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:32.776297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:32.785003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1f0442ec-38b3-4063-b149-598cfd39d079 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093362 Nov 10 16:26:32.785578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1056/2147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:33.804422 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:33.805136 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:33.813005 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:33.813439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:33.814253 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:33.814694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:33.881188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:33.889509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9e00058d-4650-4e0f-a411-1cf997acef8c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089851 Nov 10 16:26:33.890068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1092/2148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:34.910476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:34.911456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:34.921247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:34.921720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:34.922527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:34.922949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:34.996311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:35.009563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-35809578-f6f4-409f-b682-fb3ac91fc901 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.105186 Nov 10 16:26:35.010311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1057/2149] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:34 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:36.028115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:36.028787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:36.035715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:36.036172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:36.041278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:36.041896 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:36.103383 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:36.113402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a5640885-ec79-48c6-b5fa-cbf25efa89c7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089221 Nov 10 16:26:36.113941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1093/2150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:37.130836 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:37.131480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:37.138541 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:37.138983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:37.139748 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:37.140170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:37.212845 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:37.221347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-51bcc410-e2b9-4c13-b673-50b9e46b561e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094164 Nov 10 16:26:37.221931 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1058/2151] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:38.239585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:38.240206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:38.247623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:38.248138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:38.248964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:38.249401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:38.367876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:38.377338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8474d805-ea1d-4e7e-a62c-f2536e2b2edc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.141544 Nov 10 16:26:38.377906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1094/2152] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:39.398058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:39.399063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:39.413119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:39.413860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:39.415199 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:39.415915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:39.477885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:39.491390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6d488e4f-ed20-4ae1-9d4d-a9abbd94dadd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096913 Nov 10 16:26:39.491390 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1059/2153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:40.509582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:40.510352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:40.520071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:40.520641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:40.521535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:40.522029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:40.585858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:40.594403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6bd35ecb-3795-47d6-9088-969f06a086f7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088980 Nov 10 16:26:40.594971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1095/2154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:41.615015 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:41.615660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:41.625320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:41.625959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:41.627184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:41.627762 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:41.755308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:41.766673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-33df4aa8-6654-460c-9b9b-205bbe8b6400 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.158056 Nov 10 16:26:41.767245 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1060/2155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:42.787462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:42.788614 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:42.799215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:42.799658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:42.800450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:42.800873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:42.870636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:42.883092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-53fbd751-ccdd-4711-9f46-03e6324b3b7b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.101438 Nov 10 16:26:42.883947 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1096/2156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:42 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:43.684458 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:26:43.684847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:26:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:26:43.902560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:43.903219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:43.910096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:43.910579 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:43.911346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:43.911766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:43.973800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:43.981835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9d963494-b8d6-4fc1-a9ed-439badbcd20c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083734 Nov 10 16:26:43.982498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1061/2157] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:43 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:45.002605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:45.003556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:45.014113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:45.014711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:45.015497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:45.015931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:45.087781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:45.100283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-edd383b0-bb48-4d86-8917-65cd4ff2d6d4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.103844 Nov 10 16:26:45.101079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1097/2158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:44 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:46.124325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:46.124985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:46.131772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:46.132225 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:46.133045 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:46.133469 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:46.199072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:46.211884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-81961f6f-8b33-46f5-b599-ba2eb98d5398 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.093889 Nov 10 16:26:46.212769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1062/2159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:46 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:47.230954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:47.231555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:47.238735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:47.239173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:47.239943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:47.240384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:47.309817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:47.317758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5eeeaf9a-7a6c-4dba-ac07-51b8127696ae tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090517 Nov 10 16:26:47.318344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1098/2160] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:47 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:48.338419 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:48.339441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:48.347853 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:48.348296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:48.349066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:48.349488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:48.416420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:48.425302 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aa87284f-4395-44c7-bd79-6cd4f163b9a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092785 Nov 10 16:26:48.425873 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1063/2161] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:48 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:49.444093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:49.444773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:49.453020 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:49.453510 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:49.454333 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:49.454774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:49.525381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:49.534496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-71430628-adbe-4725-8819-72113eef137a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094792 Nov 10 16:26:49.535060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1099/2162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:49 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:50.030894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:26:50.031712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:26:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:26:50.551189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:50.551786 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:50.558946 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:50.559379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:50.560136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:50.560559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:50.626466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:50.639796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-260b7ce3-f375-4abe-b2ae-3069eb00c282 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092040 Nov 10 16:26:50.640694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1064/2163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:50 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:51.661596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:51.662278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:51.669279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:51.669730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:51.670547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:51.670988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:51.740901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:51.753993 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bbe3206c-b213-4d99-b5d0-4821ac29510d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095983 Nov 10 16:26:51.754860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1100/2164] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:51 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:52.774327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:52.775107 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:52.784371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:52.784952 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:52.785984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:52.786623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:52.849251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:52.857608 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-05c69ef0-eeb3-480b-93d5-27defcbeb7ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089414 Nov 10 16:26:52.858184 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1065/2165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:52 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:53.878559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:53.879525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:53.889345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:53.890007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:53.891266 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:53.892063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:53.960107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:53.968373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-db108c1a-6ae6-4978-83a6-19dc0dfee1a8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096336 Nov 10 16:26:53.968933 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1101/2166] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:53 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:54.987433 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:54.988078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:54.995165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:54.995635 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:54.996460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:54.997237 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:55.061858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:55.070180 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5a83ca2d-adfe-48f2-998c-a8b3831f56c6 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.087831 Nov 10 16:26:55.070759 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1066/2167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:54 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:56.091138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:56.092116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:56.099971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:56.100426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:56.101221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:56.101659 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:56.161067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:56.169603 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-179f912b-eded-4b44-b88d-febf61050195 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084745 Nov 10 16:26:56.170200 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1102/2168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:56 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:57.190736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:57.191692 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:57.202498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:57.203230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:57.204527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:57.204954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:57.271915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:57.284835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d471ac9c-2aa7-42ac-bb0c-652a85024f45 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100438 Nov 10 16:26:57.285550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1067/2169] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:57 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:58.310588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:58.311649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:58.319416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:58.319866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:58.320639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:58.321071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:58.381883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:58.390083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-290a38cc-bbfb-40c6-b0f0-44e852b5c6e7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085703 Nov 10 16:26:58.390731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1103/2170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:58 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:26:59.415932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:26:59.416863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:26:59.426567 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:59.427012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:59.427815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:26:59.428244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:26:59.499387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:26:59.508276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a216925a-c34b-44ca-85a7-df0ed25f986f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098371 Nov 10 16:26:59.508848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1068/2171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:26:59 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:00.528743 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:00.529644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:00.537291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:00.537742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:00.538550 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:00.538980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:00.606192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:00.614836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c04cd876-ac4a-4453-ab49-61ad9a1cd662 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092765 Nov 10 16:27:00.615400 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1104/2172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:00 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:01.633890 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:01.634615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:01.641947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:01.642566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:01.643343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:01.643787 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:01.715063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:01.727784 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-21eb0a67-344b-4b10-984a-96f12d728833 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098926 Nov 10 16:27:01.728605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1069/2173] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:01 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:02.752072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:02.753103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:02.763644 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:02.764382 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:02.765642 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:02.766501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:02.829575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:02.837520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-42e6bfa6-1342-40b0-9b5a-d919bcecff99 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092194 Nov 10 16:27:02.838080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1105/2174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:02 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:03.858327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:03.859365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:03.867410 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:03.867852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:03.868630 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:03.869060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:03.936657 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:03.949095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dc384bcc-49dd-4655-8842-4c9a658e679c tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096886 Nov 10 16:27:03.949772 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1070/2175] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:03 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:04.971985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:04.972650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:04.979358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:04.979816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:04.980593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:04.981028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:05.044080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:05.057030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-904bd99f-4ba6-44e5-9740-dfc589a2d893 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090990 Nov 10 16:27:05.057890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1106/2176] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:04 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:06.078857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:06.079522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:06.087155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:06.087603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:06.088383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:06.088813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:06.157628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:06.169601 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-88df55f4-6a6d-4746-9743-6783818927ff tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.096020 Nov 10 16:27:06.170466 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1071/2177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:06 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:07.190317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:07.191751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:07.199650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:07.200092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:07.200856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:07.201313 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:07.264226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:07.272538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-390d0d13-8ffe-4f80-b4f3-5688465880b3 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088349 Nov 10 16:27:07.273100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1107/2178] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:07 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:08.290289 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:08.290846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:08.297800 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:08.298282 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:08.299047 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:08.299465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:08.362982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:08.371841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4384f8ff-5000-4fa1-b6c2-74bacc275709 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084959 Nov 10 16:27:08.372420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1072/2179] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:08 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:27:09.392865 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:09.393798 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:09.401702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:09.402174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:09.402976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:09.403419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:09.468967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:09.477421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f89b5070-2b69-4667-bafa-288c0845453f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090843 Nov 10 16:27:09.478272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1108/2180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:09 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:10.494569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:10.495196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:10.502025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:10.502438 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:10.503216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:10.503636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:10.574510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:10.582544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-077e26d9-1a1f-4ea7-b0cd-b76034ab87bc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091999 Nov 10 16:27:10.583120 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1073/2181] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:10 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:11.601637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:11.602343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:11.609085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:11.609587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:11.610480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:11.610968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:11.672321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:11.680686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-beebcf88-b9a5-4967-a593-7fa4079d71fd tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.083983 Nov 10 16:27:11.681251 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1109/2182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:11 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:12.698954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:12.699596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:12.706315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:12.706753 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:12.707540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:12.707956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:12.768961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:12.777118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7178e044-9f23-4f2f-98ba-59c29093548e tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082096 Nov 10 16:27:12.777680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1074/2183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:12 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:13.798431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:13.799442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:13.807690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:13.808138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:13.808912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:13.809348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:13.870228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:13.882629 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5d82c7ec-599b-4c6e-863c-a9def0e68a0b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090389 Nov 10 16:27:13.883186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1110/2184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:13 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:14.902896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:14.903869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:14.913794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:14.914259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:14.915026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:14.915446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:14.976982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:14.985011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4318bd73-0e22-4598-9f56-6c20e33423cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088421 Nov 10 16:27:14.985566 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1075/2185] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:14 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:16.005750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:16.006917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:16.017738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:16.018573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:16.019874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:16.020601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:16.094594 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:16.103455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c1943ffc-8416-4f8f-be45-2f7a2ee62411 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.104046 Nov 10 16:27:16.104051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1111/2186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:15 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:17.126251 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:17.126881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:17.136755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:17.138418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:17.139504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:17.140206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:17.215468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:17.226264 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d6563367-bc37-43ab-89c6-13c0b1dee4ea tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.103838 Nov 10 16:27:17.226986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1076/2187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:17 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:27:18.247737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:18.248731 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:18.256370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:18.256844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:18.257628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:18.258062 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:18.323661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:18.334194 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-823ccf3e-d1bb-442a-b71d-7fafea0a47aa tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.092910 Nov 10 16:27:18.335037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1112/2188] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:18 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:19.351744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:19.352379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:19.358969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:19.359408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:19.360173 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:19.360594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:19.676908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:19.690618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b4825e2-5c9c-444a-b833-dd98bc6ca277 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.341966 Nov 10 16:27:19.691633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1077/2189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:19 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:20.712227 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:20.712820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:20.719455 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:20.719905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:20.720676 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:20.721114 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:20.788419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:20.797011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-27367668-b3d8-4403-8728-8e467d803156 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.091486 Nov 10 16:27:20.797570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1113/2190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:20 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:21.817495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:21.818475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:21.826756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:21.827204 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:21.828010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:21.828468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:21.888352 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:21.896372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96dfd677-2e9a-4b97-94a0-066e85a397c0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.085036 Nov 10 16:27:21.896976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1078/2191] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:21 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:22.917300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:22.918347 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:22.928943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:22.929690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:22.931070 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:22.931502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:22.997792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:23.010734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-139f4293-2da9-4c5d-ad1c-7d3ef6e5a546 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.099136 Nov 10 16:27:23.011501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1114/2192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:22 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:24.035798 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:24.037126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:24.045210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:24.045737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:24.046716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:24.047130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:24.107578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:24.115782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9e3e98b3-433c-4523-8c19-f9a416830208 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086493 Nov 10 16:27:24.116343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1079/2193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:24 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:25.134142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:25.134971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:25.141548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:25.142021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:25.142818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:25.143245 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:25.216939 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:25.231082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2211891e-8e79-4f5e-b610-e2dce3e82023 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.100484 Nov 10 16:27:25.231653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1115/2194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:25 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:26.248385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:26.249042 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:26.257997 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:26.258649 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:26.259598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:26.260034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:26.330461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:26.339050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a5e81625-4eb5-46fa-a3b2-40c98443d81a tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094727 Nov 10 16:27:26.339617 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1080/2195] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:26 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:27.359557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:27.360460 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:27.369778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:27.370257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:27.371317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:27.371800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:27.433321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:27.441940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c8ab5ed8-166b-400d-9b85-09f8ced4a36b tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088381 Nov 10 16:27:27.442538 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1116/2196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:27 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:28.467910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:28.468953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:28.479092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:28.479541 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:28.480324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:28.480756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:28.543113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:28.551848 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0e850500-a052-4e62-a12e-5661924ba2e0 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.090267 Nov 10 16:27:28.552413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1081/2197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:28 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:29.572478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:29.573088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:29.580384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:29.580849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:29.581661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:29.582113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:29.646007 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:29.654760 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e56a3410-4382-4f26-b3d8-a3e1406ae8a2 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.088041 Nov 10 16:27:29.655327 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1117/2198] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:29 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:30.675858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:30.676770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:30.685162 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:30.685603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:30.686423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:30.686856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:30.748246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:30.756188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-341b3ec1-45ca-4f18-8647-3e2d2866e6d7 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.086828 Nov 10 16:27:30.756721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1082/2199] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:30 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:31.778654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:31.779641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:31.790472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:31.790958 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:31.791711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:31.792186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:31.853771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:31.861806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d7239e26-1daf-4eeb-bf28-2c1246372cb4 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089753 Nov 10 16:27:31.862385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1118/2200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:31 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:32.880081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:32.880730 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:32.887926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:32.888392 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:32.889171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:32.889598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:32.950735 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:32.959052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8ad7883c-c6af-4323-bbe6-3ff859892edb tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.082887 Nov 10 16:27:32.959610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1083/2201] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:32 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:33.977733 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:33.978581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:33.985380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:33.985829 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:33.986668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:33.987112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:34.057902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:34.068242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75619664-93a7-43db-985b-61f159dd6848 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.095268 Nov 10 16:27:34.068856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1119/2202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:33 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:35.088605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:35.089268 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:35.096758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:35.097252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:35.098383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:35.098912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:35.169131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:35.180891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-331470f6-1325-49f2-96a8-474c2bdc5c60 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097941 Nov 10 16:27:35.181544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1084/2203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:35 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:36.200632 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:36.201396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:36.209568 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:36.210121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:36.211137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:36.211765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:36.285316 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:36.293011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6d5e96cd-fd40-43a3-82d4-af248fb2db89 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.097351 Nov 10 16:27:36.293601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1120/2204] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:36 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:37.312734 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:37.313603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:37.323959 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:37.324625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:37.325825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:37.326556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:37.404316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:37.416615 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f9ddb5c5-f461-4bde-8b35-cfb135ef01cc tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.109537 Nov 10 16:27:37.417186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1085/2205] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:37 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:38.437059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:38.437989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:38.448164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:38.448616 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:38.449394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:38.449830 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:38.520681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:38.528950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2613b884-0778-4b5f-940a-c8d31555ffc8 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.098192 Nov 10 16:27:38.529517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1121/2206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:38 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:39.549292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:39.550149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:39.559324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:39.559761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:39.560525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:39.560949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:39.625036 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:39.637531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-791a4b26-15a0-4221-b25b-6e946054829f tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.094449 Nov 10 16:27:39.638292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1086/2207] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:39 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:40.663342 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:40.664285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:40.671254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:40.671696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:40.672454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:40.672883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:40.732432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:40.740832 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-88f60f0f-a486-461e-ac57-b8aca88a956d tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.084047 Nov 10 16:27:40.741404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1122/2208] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:40 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:27:41.761825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:27:41.762863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] [instance: f732db3a-a74d-4503-8538-9bcb4136479a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:27:41.773406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:41.774134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:41.775634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:27:41.776131 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:27:41.836535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed271ee2a33f484ebb184fd30f99281b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c60a77a9e14defb1cbca4e34871865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:27:41.844975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a3f8a0a4-6725-4ebe-b42b-4a5aeeab5a76 tempest-ServerRescueNegativeTestJSON-1165805046 tempest-ServerRescueNegativeTestJSON-1165805046-project] 10.222.0.60 "GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a" status: 200 len: 1352 microversion: 2.1 time: 0.089506 Nov 10 16:27:41.845549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1087/2209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:27:41 2021] GET /compute/v2.1/servers/f732db3a-a74d-4503-8538-9bcb4136479a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:17.378640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:28:17.379500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:28:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:28:27.863971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c361ec30-fafd-427a-b4a9-5108ecd0222a"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:28:27.865019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:27.871774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:27.872217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:27.873032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:27.873459 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:28.292472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-172fba7f-9486-4a71-8c49-496cbcca14f0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432350 Nov 10 16:28:28.293091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1123/2210] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 16:28:27 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:28:29.613324 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-d90f13b0-731e-46f9-ac38-af79256cdaa9 req-176dbe0c-6df8-4ba6-ba3a-882915043001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61231004-dfd0-4036-89ca-e554dfb3876c", "name": "network-vif-deleted", "tag": "6d6ef20c-1c35-49f0-a66e-ac9018d2c5be"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:28:29.615491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:28:29.615491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:28:29.623799 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d90f13b0-731e-46f9-ac38-af79256cdaa9 req-176dbe0c-6df8-4ba6-ba3a-882915043001 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:29.624287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d90f13b0-731e-46f9-ac38-af79256cdaa9 req-176dbe0c-6df8-4ba6-ba3a-882915043001 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:29.635179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-d90f13b0-731e-46f9-ac38-af79256cdaa9 req-176dbe0c-6df8-4ba6-ba3a-882915043001 service nova] Creating event network-vif-deleted:6d6ef20c-1c35-49f0-a66e-ac9018d2c5be for instance 61231004-dfd0-4036-89ca-e554dfb3876c on hv-cinder-81708 Nov 10 16:28:29.641318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-d90f13b0-731e-46f9-ac38-af79256cdaa9 req-176dbe0c-6df8-4ba6-ba3a-882915043001 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158064 Nov 10 16:28:29.641898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1088/2211] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:28:31.029153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:28:31.029737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:28:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:28:35.791851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5a949401-3b8b-42d3-af45-ebf78e664a5c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:28:35.799337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a949401-3b8b-42d3-af45-ebf78e664a5c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:35.799822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5a949401-3b8b-42d3-af45-ebf78e664a5c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:35.866709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5a949401-3b8b-42d3-af45-ebf78e664a5c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Going to try to stop instance {{(pid=115910) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 10 16:28:35.922331 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5a949401-3b8b-42d3-af45-ebf78e664a5c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 202 len: 0 microversion: 2.1 time: 0.135854 Nov 10 16:28:35.923095 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1124/2212] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:28:35 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:28:35.933058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:35.934553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:35.943530 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:35.944006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:35.945286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:35.945744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:36.096031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:36.109061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a7cfed84-61fb-4aaf-9207-7f04fe5f4d60 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.180906 Nov 10 16:28:36.109866 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1089/2213] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:35 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:37.134835 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:37.135901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:37.143566 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:37.144107 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:37.145079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:37.145537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:37.291544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:37.311058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-475c1363-a2b3-4a2a-93da-0282c9fb89a8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.183433 Nov 10 16:28:37.311653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1125/2214] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:37 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:38.328455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:38.329900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:38.336498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:38.337007 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:38.337882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:38.338400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:38.477357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:38.485497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fff719fa-80c6-429a-83ac-3d5f42f821e3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.160748 Nov 10 16:28:38.486055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1090/2215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:38 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:39.505303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:39.505994 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:39.512877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:39.513399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:39.514301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:39.514793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:39.672440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:39.684673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-be666385-8ce2-41e5-9db3-429041219321 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.184636 Nov 10 16:28:39.685233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1126/2216] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:39 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:40.711222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:40.711906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:40.718091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:40.718595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:40.719372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:40.719791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:40.898463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:40.906847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3fc9894e-3fa1-4e31-a73e-45f28a6db26f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.200053 Nov 10 16:28:40.907408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1091/2217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:40 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:41.924008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:41.924609 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:41.931234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:41.931684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:41.932472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:41.933071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:42.074639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:42.082558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1c5f8596-d4bf-4a3e-bfdd-e88af3eeac83 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.162269 Nov 10 16:28:42.083357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1127/2218] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:41 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:43.100695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:43.101321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:43.107887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:43.108339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:43.109103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:43.109524 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:43.248194 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:43.255908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1a1b872b-f759-4019-b617-77083eb6dd9c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.158977 Nov 10 16:28:43.256473 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1092/2219] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:43 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:44.274151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:44.274786 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:44.282887 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:44.283356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:44.284125 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:44.284549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:44.434357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:44.442882 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-48415938-43df-462e-98d6-885a72abe0d2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.173274 Nov 10 16:28:44.443543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1128/2220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:44 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:45.464497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:45.465488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:45.477222 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:45.477986 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:45.479343 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:45.480056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:45.630104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:45.638455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f0f891be-1d0d-446b-b8fb-1504858b5f69 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1723 microversion: 2.1 time: 0.180118 Nov 10 16:28:45.639151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1093/2221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:45 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:46.658442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:46.659176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:46.665794 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:46.666282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:46.667076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:46.667513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:46.805980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:46.814378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-58016aba-6ee4-4873-b988-6fb8e0750670 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1700 microversion: 2.1 time: 0.161573 Nov 10 16:28:46.815208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1129/2222] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:46 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:46.832559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d8cda762-eabb-4252-b424-cbaac317b396 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:28:46.839060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8cda762-eabb-4252-b424-cbaac317b396 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:46.839503 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8cda762-eabb-4252-b424-cbaac317b396 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:46.898750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d8cda762-eabb-4252-b424-cbaac317b396 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Going to try to start instance {{(pid=115911) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 10 16:28:46.950709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d8cda762-eabb-4252-b424-cbaac317b396 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 202 len: 0 microversion: 2.1 time: 0.122802 Nov 10 16:28:46.951232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1094/2223] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:28:46 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:28:46.959790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:46.960442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:46.966677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:46.967167 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:46.967918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:46.968378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:47.144709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:47.153148 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-94821eea-28f8-419e-8149-30397c2f386a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1709 microversion: 2.1 time: 0.197078 Nov 10 16:28:47.153878 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1130/2224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:46 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:48.174497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:48.175092 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:48.182081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:48.182549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:48.183447 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:48.183879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:48.332953 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:48.342000 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-845ab09b-96c9-4108-ace2-ae248c17bc97 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1709 microversion: 2.1 time: 0.172726 Nov 10 16:28:48.342741 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1095/2225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:48 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:28:49.367112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:28:49.367738 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:28:49.375279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:49.375728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:49.376509 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:28:49.376944 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:28:49.517101 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:28:49.529324 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aebdd31b-5c05-48f0-a7d7-a45805f7aaed tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1713 microversion: 2.1 time: 0.171559 Nov 10 16:28:49.529990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1131/2226] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:28:49 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1713 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:22.402104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:22.402782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:22.408967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:22.409409 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:22.410814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:22.411127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:22.495528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lazy-loading 'services' on Instance uuid 411c29a5-496c-4064-a314-d21bd0293673 {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:29:22.576314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-acaf1108-376f-49c1-b678-ec93539b5f6b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments/c361ec30-fafd-427a-b4a9-5108ecd0222a" status: 202 len: 0 microversion: 2.1 time: 0.178009 Nov 10 16:29:22.576910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1096/2227] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:29:22 2021] DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments/c361ec30-fafd-427a-b4a9-5108ecd0222a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:29:23.691814 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-20ada759-3d86-403c-8658-0a0489b7949a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:29:23.698340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ada759-3d86-403c-8658-0a0489b7949a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:23.698793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-20ada759-3d86-403c-8658-0a0489b7949a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:23.721708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-20ada759-3d86-403c-8658-0a0489b7949a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Going to try to stop instance {{(pid=115910) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 10 16:29:23.773447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-20ada759-3d86-403c-8658-0a0489b7949a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 202 len: 0 microversion: 2.1 time: 0.085204 Nov 10 16:29:23.774708 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1132/2228] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:29:23 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:29:23.783491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:23.784852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:23.792595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:23.793313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:23.794389 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:23.795527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:23.966539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:23.975393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d8052a3d-50c2-4d28-bdec-40b6dc08dae5 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.196347 Nov 10 16:29:23.985639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1097/2229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:23 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:24.999299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:25.000436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:25.009272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:25.009710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:25.010534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:25.010962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:25.162318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:25.170380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4f9b76a4-e9f3-4822-83f1-14f548543890 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.178865 Nov 10 16:29:25.170960 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1133/2230] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:24 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:26.192138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:26.193144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:26.204072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:26.204812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:26.206069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:26.206860 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:26.349378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:26.357710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7e5b2fab-bc7a-486e-82ec-7ab361b69f1f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.171971 Nov 10 16:29:26.358291 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1098/2231] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:26 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:27.383688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:27.384677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:27.395487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:27.396237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:27.397776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:27.398556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:27.550386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:27.558026 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-41c91985-ee61-4e02-a1eb-39a48fc6dd85 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.180640 Nov 10 16:29:27.558621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1134/2232] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:27 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:28.579372 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:28.580311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:28.590796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:28.591523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:28.592790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:28.593497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:28.730857 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:28.739098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-55fa1a00-63e7-4b23-9b32-8ff073c72fb7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.166169 Nov 10 16:29:28.739665 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1099/2233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:28 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:29.767255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:29.768195 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:29.776623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:29.777080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:29.777858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:29.778338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:29.917440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:29.925548 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f5319e39-193c-4ae2-af63-791852e13892 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.164644 Nov 10 16:29:29.926078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1135/2234] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:29 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:30.943165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:30.943835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:30.950407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:30.950856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:30.951623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:30.952053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:31.089070 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:31.100378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-99c96081-f0c5-491f-b9a6-a74281ff2441 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.160867 Nov 10 16:29:31.100941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1100/2235] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:30 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:32.122024 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:32.123029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:32.133691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:32.134493 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:32.135779 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:32.136497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:32.275301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:32.283214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-222b3701-d125-4b40-b784-fd45893c4208 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.167912 Nov 10 16:29:32.283778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1136/2236] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:32 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:33.304822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:33.305796 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:33.316426 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:33.317152 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:33.318540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:33.318970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:33.470387 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:33.478082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-614dc6a7-ae9e-44b4-9f96-a6b5b2b0e45f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1677 microversion: 2.1 time: 0.179883 Nov 10 16:29:33.478669 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1101/2237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:33 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:34.498189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:34.498910 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:34.507229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:34.507701 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:34.508477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:34.508912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:34.647040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:34.658051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-467c6811-ae31-4228-a0e0-0f72a3be3bfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1654 microversion: 2.1 time: 0.165073 Nov 10 16:29:34.658846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1137/2238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:34 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:34.675461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aeb2a3fd-df46-48ba-b1e9-2defae5d1a1b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:29:34.682484 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aeb2a3fd-df46-48ba-b1e9-2defae5d1a1b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:34.682907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aeb2a3fd-df46-48ba-b1e9-2defae5d1a1b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:34.705167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aeb2a3fd-df46-48ba-b1e9-2defae5d1a1b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Going to try to start instance {{(pid=115911) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 10 16:29:34.760341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aeb2a3fd-df46-48ba-b1e9-2defae5d1a1b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action" status: 202 len: 0 microversion: 2.1 time: 0.088227 Nov 10 16:29:34.761072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1102/2239] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:29:34 2021] POST /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:29:34.769123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:34.769736 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:34.776595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:34.777115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:34.777877 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:34.778420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:34.937069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:34.945431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-75623273-677f-41dd-ad63-3c7d84feb980 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1663 microversion: 2.1 time: 0.180074 Nov 10 16:29:34.946000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1138/2240] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:34 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:35.964382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:29:35.965205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:29:35.971538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:35.971984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:35.972813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:29:35.973249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:29:36.113134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:29:36.125722 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8e140d0f-dbf2-436a-94eb-c51ded347079 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1667 microversion: 2.1 time: 0.165692 Nov 10 16:29:36.126521 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1103/2241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:29:35 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:29:45.418192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:29:45.419273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:29:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:30:08.064035 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:08.065000 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:08.071517 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.071969 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.072734 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.073161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.103001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-15f4f120-ee50-4ad3-aa73-d00f3b221fe7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042795 Nov 10 16:30:08.103539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1139/2242] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:30:08 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:08.163365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:08.163846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:08.170110 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.170595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.171367 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.171793 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.198348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:30:08.280607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cc4eca0e-4d30-4f9b-82c1-b381a801ccf4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 204 len: 0 microversion: 2.1 time: 0.120596 Nov 10 16:30:08.281105 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1104/2243] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:30:08 2021] DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:30:08.289540 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:08.290142 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:08.296262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.296711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.297470 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:08.297929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:08.440751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:08.448922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e8509e75-4955-455e-a0af-30c582cff4ba tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1673 microversion: 2.1 time: 0.163134 Nov 10 16:30:08.449486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1140/2244] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:08 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:09.468242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:09.468983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:09.476091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:09.476528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:09.477320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:09.478329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:09.739005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:09.747322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-055cda1c-f109-4a4e-a336-265662e76cd3 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 200 len: 1673 microversion: 2.1 time: 0.284015 Nov 10 16:30:09.747892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1105/2245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:09 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 1673 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:10.241595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-08d9b411-3b62-43af-bbbf-7cc1ab3c0358 req-88a71438-7e6d-4087-a83a-529deccf6f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411c29a5-496c-4064-a314-d21bd0293673", "name": "network-vif-deleted", "tag": "2d9ddefc-f5c6-4117-968a-4cad125fbfdc"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:10.244291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:10.244291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:30:10.263197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-08d9b411-3b62-43af-bbbf-7cc1ab3c0358 req-88a71438-7e6d-4087-a83a-529deccf6f09 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:10.264069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-08d9b411-3b62-43af-bbbf-7cc1ab3c0358 req-88a71438-7e6d-4087-a83a-529deccf6f09 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:10.278722 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-08d9b411-3b62-43af-bbbf-7cc1ab3c0358 req-88a71438-7e6d-4087-a83a-529deccf6f09 service nova] Creating event network-vif-deleted:2d9ddefc-f5c6-4117-968a-4cad125fbfdc for instance 411c29a5-496c-4064-a314-d21bd0293673 on hv-cinder-81708 Nov 10 16:30:10.283957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-08d9b411-3b62-43af-bbbf-7cc1ab3c0358 req-88a71438-7e6d-4087-a83a-529deccf6f09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047904 Nov 10 16:30:10.284780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1141/2246] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:10.766170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:10.766971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:10.773475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:10.773901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:10.774711 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:10.775141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:10.788842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. Nov 10 16:30:10.789429 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:30:10.790273 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4e8378bf-806c-4d83-a695-aead481e7626 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 404 len: 111 microversion: 2.1 time: 0.027954 Nov 10 16:30:10.790839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1106/2247] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:10 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:30:10.799881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c8880fac-c928-4f8f-baa7-a65c67d69b90 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '.version_select at 0x7faa9b465ee0>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:10.822688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c8880fac-c928-4f8f-baa7-a65c67d69b90 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220523828" status: 202 len: 0 microversion: 2.1 time: 0.026834 Nov 10 16:30:10.823518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1142/2248] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Nov 10 16:30:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220523828 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 10 16:30:11.736408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: .version_select at 0x7faaad07eee0>, body: {"keypair": {"name": "tempest-keypair-669491886"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:11.757439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:30:11.761301 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:30:12.019125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:30:12.023404 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:30:12.036192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1c70b41c-5476-4087-b49e-d93ff2556b70 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.303576 Nov 10 16:30:12.036895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1107/2249] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Nov 10 16:30:11 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:13.402371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1588881614", "imageRef": "bd6f7b82-725c-43f4-a9c5-b8defd019dc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5016f302-6b13-48d0-b6e2-188d1a94cbfc"}], "security_groups": [{"name": "tempest-securitygroup--1834868207"}], "key_name": "tempest-keypair-669491886", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:13.507011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] validate_networks() for [('5016f302-6b13-48d0-b6e2-188d1a94cbfc', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:30:14.038059 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:30:14.038551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:30:14.039023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:30:14.039446 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:30:14.039849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:30:14.049661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:14.050103 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:14.051021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:14.051595 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:14.077255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:30:14.083801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Getting quotas for user b865802b111a42118b385d68fb89f352 and project 9f86f93bf80849ffadb5e07891102ce5. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:30:14.102881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:30:14.106840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd6f7b82-725c-43f4-a9c5-b8defd019dc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:30:14.162216 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7291d445-f100-4042-a99b-3131ddd476af tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.763746 Nov 10 16:30:14.162849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1143/2250] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:30:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:30:14.173114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-96c4998b-24b1-4c26-b459-a4b0d29afeef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:14.173729 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-96c4998b-24b1-4c26-b459-a4b0d29afeef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:14.229732 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-96c4998b-24b1-4c26-b459-a4b0d29afeef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:14.236785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-96c4998b-24b1-4c26-b459-a4b0d29afeef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1237 microversion: 2.1 time: 0.067616 Nov 10 16:30:14.237364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1108/2251] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:14 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:15.255204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:15.255803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:15.267298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:15.267741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:15.268781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:15.269217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:15.342756 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:15.350131 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bafd7cac-38ce-4160-89fc-bf980de68575 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1297 microversion: 2.1 time: 0.099084 Nov 10 16:30:15.350787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1144/2252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:15 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:16.367688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:16.368979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:16.376459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:16.376908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:16.377750 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:16.378522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:16.600546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:16.610896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-269fed22-1ca2-4b31-8a14-8e724cd9a00f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.246986 Nov 10 16:30:16.611557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1109/2253] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:16 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:16.722092 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-532aa503-09b4-4a46-90fb-b876dcf0c2b2 req-b0809179-7d3a-4b35-8394-af436d88c5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e", "tag": "7d60208b-12de-4927-b2c1-fe03c2f42c2b"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:16.725514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:16.725514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:30:16.736705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-532aa503-09b4-4a46-90fb-b876dcf0c2b2 req-b0809179-7d3a-4b35-8394-af436d88c5d1 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:16.737254 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-532aa503-09b4-4a46-90fb-b876dcf0c2b2 req-b0809179-7d3a-4b35-8394-af436d88c5d1 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:16.756264 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-532aa503-09b4-4a46-90fb-b876dcf0c2b2 req-b0809179-7d3a-4b35-8394-af436d88c5d1 service nova] Creating event network-changed:7d60208b-12de-4927-b2c1-fe03c2f42c2b for instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e on hv-cinder-81708 Nov 10 16:30:16.764439 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-532aa503-09b4-4a46-90fb-b876dcf0c2b2 req-b0809179-7d3a-4b35-8394-af436d88c5d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046354 Nov 10 16:30:16.765173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1145/2254] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:17.628595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:17.629187 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:17.636113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:17.636565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:17.637350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:17.637783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:17.856881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:17.866538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-71a99e21-a7fb-41ee-85a9-3b72bcc415cb tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.241314 Nov 10 16:30:17.867655 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1110/2255] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:17 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:18.891399 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:18.892526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:18.901438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:18.901892 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:18.902707 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:18.903173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:19.049696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:19.058909 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9d2cd689-67d2-4b0c-bb6a-2163768a98c0 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.174911 Nov 10 16:30:19.059462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1146/2256] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:18 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:20.079816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:20.080837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:20.091855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:20.092599 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:20.093911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:20.094698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:20.244495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:20.252172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f0cd0941-4e66-4184-9e64-b1728f9106f1 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.178741 Nov 10 16:30:20.252713 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1111/2257] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:20 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:21.269473 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:21.270087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:21.277182 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:21.277639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:21.278453 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:21.278890 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:21.426598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:21.434496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-08f9bd6e-0b0a-40c6-96c3-91a70840ac71 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.168796 Nov 10 16:30:21.435066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1147/2258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:21 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:22.455670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:22.456820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:22.467915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.468647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.469916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.470675 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.535544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:22.536068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:22.542807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.543208 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.544021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.544504 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.569499 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:30:22.605040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:22.612767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8c0eddfc-213a-427a-8171-24edef848dbf tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.163172 Nov 10 16:30:22.624628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1112/2259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:22 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:22.654303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-807af78a-70d8-4201-99d2-74b04f2d8060 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 204 len: 0 microversion: 2.1 time: 0.122143 Nov 10 16:30:22.654980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1148/2260] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:30:22 2021] DELETE /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 10 16:30:22.664266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:22.664879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:22.671353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.672252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.672716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.673151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.812596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:22.821232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-92521fa3-435d-449e-ad77-b888643a08df tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1559 microversion: 2.1 time: 0.161297 Nov 10 16:30:22.822143 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1113/2261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:22 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:22.889876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-35574503-cb2f-4164-a376-247448cf065d req-fa40026e-d5b7-441a-a9cb-2a6df2e4f10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e", "name": "network-vif-plugged", "status": "completed", "tag": "7d60208b-12de-4927-b2c1-fe03c2f42c2b"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:22.892230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:22.892230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:30:22.899735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-35574503-cb2f-4164-a376-247448cf065d req-fa40026e-d5b7-441a-a9cb-2a6df2e4f10d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:22.900181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-35574503-cb2f-4164-a376-247448cf065d req-fa40026e-d5b7-441a-a9cb-2a6df2e4f10d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:22.913230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-35574503-cb2f-4164-a376-247448cf065d req-fa40026e-d5b7-441a-a9cb-2a6df2e4f10d service nova] Creating event network-vif-plugged:7d60208b-12de-4927-b2c1-fe03c2f42c2b for instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e on hv-cinder-81708 Nov 10 16:30:22.918888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-35574503-cb2f-4164-a376-247448cf065d req-fa40026e-d5b7-441a-a9cb-2a6df2e4f10d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164099 Nov 10 16:30:22.919658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1149/2262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:30:23.631813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:23.632598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:23.640055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:23.640498 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:23.641297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:23.641698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:23.838497 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:23.839742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:23.840528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:23.849354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aff14d0b-d6f5-49c8-92ea-5832053e40ce tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1363 microversion: 2.1 time: 0.220358 Nov 10 16:30:23.862824 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1114/2263] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:23 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:23.862998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:23.863119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:23.875441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:23.875893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:24.198620 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:24.200010 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-272236d5-64b3-4edf-96f3-c6997ef99035 req-cb9bfa60-794b-4a7b-b404-71ffc500f96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da545b27-f196-4505-9b6b-c2cf256f84b9", "name": "network-vif-deleted", "tag": "46843532-4859-472a-8809-3b25ce7a2743"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:24.202190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:24.202190 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:30:24.210592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-272236d5-64b3-4edf-96f3-c6997ef99035 req-cb9bfa60-794b-4a7b-b404-71ffc500f96e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:24.211442 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-272236d5-64b3-4edf-96f3-c6997ef99035 req-cb9bfa60-794b-4a7b-b404-71ffc500f96e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:24.213581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5e6e2888-52a2-42d4-95d7-2d1746509eec tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 200 len: 1517 microversion: 2.1 time: 0.378730 Nov 10 16:30:24.218218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1150/2264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:23 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:24.233034 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-272236d5-64b3-4edf-96f3-c6997ef99035 req-cb9bfa60-794b-4a7b-b404-71ffc500f96e service nova] Creating event network-vif-deleted:46843532-4859-472a-8809-3b25ce7a2743 for instance da545b27-f196-4505-9b6b-c2cf256f84b9 on hv-cinder-81708 Nov 10 16:30:24.242778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-272236d5-64b3-4edf-96f3-c6997ef99035 req-cb9bfa60-794b-4a7b-b404-71ffc500f96e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047734 Nov 10 16:30:24.243398 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1115/2265] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:30:24.873338 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:24.873889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:24.880866 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:24.881321 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:24.882108 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:24.882587 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.031229 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:25.042508 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-43c65d88-8324-4791-ba5e-616751044c7e tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1549 microversion: 2.1 time: 0.172827 Nov 10 16:30:25.043273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1151/2266] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:24 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:25.063699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:25.064261 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:25.071130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.071574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.072357 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.072783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.158210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-481ab4d1-6989-43b9-8cdd-387c82b36f7c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098696 Nov 10 16:30:25.159265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1116/2267] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Nov 10 16:30:25 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:25.230529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:25.231057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: da545b27-f196-4505-9b6b-c2cf256f84b9] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:25.237667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.238119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.238945 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.239378 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.255071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Instance da545b27-f196-4505-9b6b-c2cf256f84b9 could not be found. Nov 10 16:30:25.255654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 404 to user: Instance da545b27-f196-4505-9b6b-c2cf256f84b9 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:30:25.256536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a347d09f-dc4d-4c9d-bf33-341c451bbe81 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9" status: 404 len: 111 microversion: 2.1 time: 0.030046 Nov 10 16:30:25.257086 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1152/2268] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:25 2021] GET /compute/v2.1/servers/da545b27-f196-4505-9b6b-c2cf256f84b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:30:25.266284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:25.266809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:25.273308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.274084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.275109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.275546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.300197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:30:25.377287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7eaeed67-9727-4834-a18e-b3de7bf6efcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 204 len: 0 microversion: 2.1 time: 0.115309 Nov 10 16:30:25.377968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1117/2269] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:30:25 2021] DELETE /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:30:25.386634 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:25.387623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:25.393927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.394408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.395219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:25.395652 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:25.671643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:25.679730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-aebc02e0-5381-4d5f-bba4-fe2959535bcf tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1515 microversion: 2.1 time: 0.297353 Nov 10 16:30:25.680576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1153/2270] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:25 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:26.391421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:26.392621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:26.399506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.400098 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.400912 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.401400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.421153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-a68fbf07-ca7c-48dd-8f56-fe4f4b13f3ec req-f4223e1d-dab2-44a9-9596-125112a3ed3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e", "tag": "7d60208b-12de-4927-b2c1-fe03c2f42c2b"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:26.423673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:26.423673 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:30:26.431371 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a68fbf07-ca7c-48dd-8f56-fe4f4b13f3ec req-f4223e1d-dab2-44a9-9596-125112a3ed3d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.431822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-a68fbf07-ca7c-48dd-8f56-fe4f4b13f3ec req-f4223e1d-dab2-44a9-9596-125112a3ed3d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.443535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-a68fbf07-ca7c-48dd-8f56-fe4f4b13f3ec req-f4223e1d-dab2-44a9-9596-125112a3ed3d service nova] Creating event network-changed:7d60208b-12de-4927-b2c1-fe03c2f42c2b for instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e on hv-cinder-81708 Nov 10 16:30:26.449117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-a68fbf07-ca7c-48dd-8f56-fe4f4b13f3ec req-f4223e1d-dab2-44a9-9596-125112a3ed3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031951 Nov 10 16:30:26.450145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1154/2271] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:26.466754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5e59879c-7954-4865-879a-e5690f505ed8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.074994 Nov 10 16:30:26.466754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1118/2272] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:26 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:26.703180 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:26.706257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:26.716228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.716917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.718040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.718716 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.760521 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:26.760977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:26.761447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lazy-loading 'fault' on Instance uuid 309121c6-e652-4f46-abe4-3db6f43261c8 {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:30:26.803135 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:26.810840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fa8db01e-4709-4a2b-87af-061def4438f7 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 200 len: 1308 microversion: 2.1 time: 0.117483 Nov 10 16:30:26.811663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1155/2273] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:26 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:27.476624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:27.477984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:27.485822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:27.486320 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:27.487086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:27.487708 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:27.545970 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-71a6ec1d-6c3c-42a4-8bf9-38b8bdd9cdfe tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.073256 Nov 10 16:30:27.546570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1119/2274] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:27 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:27.831934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:27.832776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 309121c6-e652-4f46-abe4-3db6f43261c8] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:27.841246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:27.841705 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:27.842524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:27.842962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:27.856585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Instance 309121c6-e652-4f46-abe4-3db6f43261c8 could not be found. Nov 10 16:30:27.857177 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 404 to user: Instance 309121c6-e652-4f46-abe4-3db6f43261c8 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:30:27.858032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-88aeb9e5-6be8-4100-90d2-c2bfe107650c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8" status: 404 len: 111 microversion: 2.1 time: 0.032553 Nov 10 16:30:27.858600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1156/2275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:27 2021] GET /compute/v2.1/servers/309121c6-e652-4f46-abe4-3db6f43261c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:30:28.473896 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-36f8141e-cef6-4f97-9449-f9d4885b1ab9 req-9a9c68cb-26ab-4797-bedb-bcf1293b1c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309121c6-e652-4f46-abe4-3db6f43261c8", "name": "network-vif-deleted", "tag": "e3fd1062-bc94-48e4-9295-a035dcf9fb65"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:28.475395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:28.475395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:30:28.483862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-36f8141e-cef6-4f97-9449-f9d4885b1ab9 req-9a9c68cb-26ab-4797-bedb-bcf1293b1c7e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:28.484431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-36f8141e-cef6-4f97-9449-f9d4885b1ab9 req-9a9c68cb-26ab-4797-bedb-bcf1293b1c7e service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:28.497346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-36f8141e-cef6-4f97-9449-f9d4885b1ab9 req-9a9c68cb-26ab-4797-bedb-bcf1293b1c7e service nova] Creating event network-vif-deleted:e3fd1062-bc94-48e4-9295-a035dcf9fb65 for instance 309121c6-e652-4f46-abe4-3db6f43261c8 on hv-cinder-81708 Nov 10 16:30:28.502262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-36f8141e-cef6-4f97-9449-f9d4885b1ab9 req-9a9c68cb-26ab-4797-bedb-bcf1293b1c7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034123 Nov 10 16:30:28.503068 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1120/2276] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:28.558855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:28.559849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:28.566923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:28.567425 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:28.568279 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:28.568771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:28.627307 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-28c865a0-44a0-435c-a5d5-92a9edd80465 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.073509 Nov 10 16:30:28.627921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1157/2277] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:28 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:29.022889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:29.023480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:29.031817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.032247 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.033266 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.033696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.061876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:30:29.147832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-af83f46a-fef3-4793-8bcb-9f275d8aee9c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 204 len: 0 microversion: 2.1 time: 0.128795 Nov 10 16:30:29.148453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1121/2278] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:30:29 2021] DELETE /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:30:29.157213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:29.157920 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:29.165669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.166119 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.166967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.167397 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.307791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:29.315328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f00e41a7-faf1-422f-9abd-194c7f7ca547 tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1513 microversion: 2.1 time: 0.162353 Nov 10 16:30:29.315900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1158/2279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:29 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:29.642815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:29.643835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:29.654252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.654861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.656019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:29.656535 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:29.723151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d514f165-8880-4573-baf1-9dbc81d76f21 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.086508 Nov 10 16:30:29.723911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1122/2280] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:29 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:30.319851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-002335ae-9203-43b7-89b0-5220ba9e45d6 req-faabce53-2df6-4e95-9673-77f62f533c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f78d736-2ad3-4754-9535-b5b568684214", "name": "network-vif-deleted", "tag": "7efb781b-3630-4096-879d-33f8232886c9"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:30.321417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:30:30.321417 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:30:30.329531 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-002335ae-9203-43b7-89b0-5220ba9e45d6 req-faabce53-2df6-4e95-9673-77f62f533c20 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.329965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-002335ae-9203-43b7-89b0-5220ba9e45d6 req-faabce53-2df6-4e95-9673-77f62f533c20 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.334205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:30.335176 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:30.341876 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-002335ae-9203-43b7-89b0-5220ba9e45d6 req-faabce53-2df6-4e95-9673-77f62f533c20 service nova] Creating event network-vif-deleted:7efb781b-3630-4096-879d-33f8232886c9 for instance 1f78d736-2ad3-4754-9535-b5b568684214 on hv-cinder-81708 Nov 10 16:30:30.344413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.344862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.346223 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.346676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.346773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-002335ae-9203-43b7-89b0-5220ba9e45d6 req-faabce53-2df6-4e95-9673-77f62f533c20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092886 Nov 10 16:30:30.347364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1159/2281] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:30:30.384197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.384646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.385118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lazy-loading 'fault' on Instance uuid 1f78d736-2ad3-4754-9535-b5b568684214 {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:30:30.425475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50d9103fa7d4f74bd77defac782f225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e776c427146842c1ba9637dc29f7281e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:30:30.432942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f73a1ea1-4c40-4170-98ce-0847c1f848ab tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 200 len: 1307 microversion: 2.1 time: 0.104095 Nov 10 16:30:30.433508 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1123/2282] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:30 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:30:30.735884 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:30.736873 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:30.744040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.744726 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.745543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:30.746008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:30.807501 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-b8fba1e3-3458-46d7-9ccb-b98f7f675a3b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.076770 Nov 10 16:30:30.808262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1160/2283] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:30 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:31.449386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:30:31.450093 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] [instance: 1f78d736-2ad3-4754-9535-b5b568684214] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:31.456678 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:31.457118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:31.457876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:31.458339 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:31.471624 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] HTTP exception thrown: Instance 1f78d736-2ad3-4754-9535-b5b568684214 could not be found. Nov 10 16:30:31.472206 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] Returning 404 to user: Instance 1f78d736-2ad3-4754-9535-b5b568684214 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:30:31.473020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8de3caea-cb60-4c78-a25e-9de11d864c0c tempest-AttachVolumeNegativeTest-92903552 tempest-AttachVolumeNegativeTest-92903552-project] 10.222.0.60 "GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214" status: 404 len: 111 microversion: 2.1 time: 0.027354 Nov 10 16:30:31.473558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1124/2284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:30:31 2021] GET /compute/v2.1/servers/1f78d736-2ad3-4754-9535-b5b568684214 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:30:31.820903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:31.821911 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:31.829416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:31.829863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:31.830672 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:31.831120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:31.891463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d3f13e01-34e6-4a55-a861-acc6e2a82c33 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.075009 Nov 10 16:30:31.892093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1161/2285] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:31 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:32.905710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:32.906737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:32.913413 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:32.913855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:32.914679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:32.915111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:32.977013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-89c4a775-9bff-41fd-92b5-cef07392572b tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.076416 Nov 10 16:30:32.977737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1125/2286] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:32 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:33.989526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:33.990742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:33.998750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:33.999215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:34.000120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:34.000686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:34.062771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-551c5ccb-fa23-4d38-b533-605d0ed85af4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.077102 Nov 10 16:30:34.063438 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1162/2287] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:33 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:35.074588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:35.075602 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:35.082837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:35.083285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:35.085104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:35.085459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:35.148299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dd7443e6-241e-4de0-b4bf-19fd1188224d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.077707 Nov 10 16:30:35.148855 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1126/2288] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:35 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:36.159688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:36.160763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:36.168414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:36.168859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:36.169639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:36.170073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:36.237389 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0f06de43-7ff4-4f9e-938a-8fe3265ab766 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 14 microversion: 2.1 time: 0.081693 Nov 10 16:30:36.238022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1163/2289] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:36 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:30:37.250634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:37.251744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:37.259761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:37.260396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:37.261179 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:37.261609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:39.853134 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-51bc8c17-506d-4384-bac5-9370e7fc982a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 19342 microversion: 2.1 time: 2.606346 Nov 10 16:30:39.854205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1127/2290] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:37 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 19342 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:40.868863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:40.869880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:40.877189 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:40.877637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:40.878454 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:40.878889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:40.956105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e6846c6f-c893-49aa-b33c-417769beaab2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 22021 microversion: 2.1 time: 0.091657 Nov 10 16:30:40.957272 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1164/2291] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:40 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 22021 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:41.969186 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:41.970243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:41.979883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:41.980443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:41.981255 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:41.981681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:42.056869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-823b8b9b-b27b-4108-ab62-e77cfa4452d9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 23235 microversion: 2.1 time: 0.091777 Nov 10 16:30:42.057672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1128/2292] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:41 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 23235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:43.069820 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:43.070968 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:43.078172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:43.078657 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:43.079402 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:43.079851 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:43.155432 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-af4c943f-1d66-4daf-bb72-e291c7d4643a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 24875 microversion: 2.1 time: 0.089498 Nov 10 16:30:43.156008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1165/2293] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:43 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 24875 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:44.168305 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:44.169376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:44.177545 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:44.178018 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:44.178856 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:44.179461 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:44.257869 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b1292c52-da52-48c3-b0e1-36e0adbfc328 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 26134 microversion: 2.1 time: 0.093437 Nov 10 16:30:44.258571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1129/2294] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:44 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 26134 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:45.271294 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:45.272291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:45.279489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:45.279934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:45.280709 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:45.281140 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:45.362386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f6f0023c-0304-4054-b06c-072a8584e1d7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 27139 microversion: 2.1 time: 0.094898 Nov 10 16:30:45.363055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1166/2295] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:45 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 27139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:46.375898 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:46.376910 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:46.384262 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:46.384682 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:46.385471 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:46.385895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:46.465625 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f51a5ed9-85ed-4e2f-ab95-8801b9e8020c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 27728 microversion: 2.1 time: 0.093662 Nov 10 16:30:46.466270 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1130/2296] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:46 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 27728 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:47.479173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:47.480164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:47.487492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:47.487937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:47.488703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:47.489132 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:47.572419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-97674065-7e53-4b55-bcf6-58cbea061f1a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28208 microversion: 2.1 time: 0.097221 Nov 10 16:30:47.573052 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1167/2297] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:47 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:48.589265 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:48.591841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:48.601949 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:48.602556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:48.603802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:48.604463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:48.668224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d59c0190-8086-4843-9021-d7842c759fef tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28208 microversion: 2.1 time: 0.084130 Nov 10 16:30:48.668883 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1131/2298] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:48 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28208 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 10 16:30:49.680668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:49.681826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:49.689393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:49.689846 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:49.690759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:49.691225 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:49.770811 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-321f12dd-8654-4e66-85a0-f46b8deecb2c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28461 microversion: 2.1 time: 0.094189 Nov 10 16:30:49.771423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1168/2299] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:49 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:50.783511 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:50.784578 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:50.792297 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:50.793803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:50.794755 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:50.795147 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:50.871393 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-667f4a33-e416-480b-a139-00327bfd21a2 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28667 microversion: 2.1 time: 0.092335 Nov 10 16:30:50.872157 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1132/2300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:50 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28667 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:51.884631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:51.885633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:51.893128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:51.893571 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:51.894426 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:51.894953 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:51.962686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5bc32521-7c1f-4eee-a596-1c78d12de74f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28667 microversion: 2.1 time: 0.082148 Nov 10 16:30:51.963323 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1169/2301] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:51 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28667 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:52.975775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:52.976840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:52.984402 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:52.984948 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:52.986021 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:52.986749 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:53.051113 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-35d3e773-2559-43b8-92a6-6bfe680aabe6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28667 microversion: 2.1 time: 0.079318 Nov 10 16:30:53.055189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1133/2302] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:52 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28667 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:54.064003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:54.065036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:54.072436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:54.072883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:54.073688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:54.074223 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:54.140628 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-79d32404-62a4-48d6-8563-125099340357 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 28667 microversion: 2.1 time: 0.080701 Nov 10 16:30:54.141430 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1170/2303] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:54 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 28667 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:55.153927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:55.155006 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:55.162476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:55.163028 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:55.163884 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:55.164317 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:55.244459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6e8105e4-adc0-4653-8109-7e53cacaf19d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 30700 microversion: 2.1 time: 0.094685 Nov 10 16:30:55.245539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1134/2304] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:55 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 30700 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:56.257292 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:56.258354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:56.265802 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:56.266465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:56.267159 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:56.267585 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:58.668221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a250b756-e1a5-4071-bdfd-0caebb722e4a tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 34188 microversion: 2.1 time: 2.414411 Nov 10 16:30:58.669210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1171/2305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:56 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 34188 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:30:59.686820 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:30:59.688329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:30:59.695614 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:59.696053 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:30:59.696926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:30:59.697355 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:01.962457 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-89641bcb-5c49-4d76-b7a8-a2ad609e3f09 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 38132 microversion: 2.1 time: 2.281576 Nov 10 16:31:01.963483 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1135/2306] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:30:59 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 38132 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:31:02.977367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:02.978372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:02.987424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:02.987924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:02.988918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:02.989519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:03.076066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8b247d9c-bc5a-4957-97f8-1621b66fbb62 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 38202 microversion: 2.1 time: 0.102503 Nov 10 16:31:03.076658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1172/2307] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:31:02 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 38202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:31:04.092309 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:04.093653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:04.103181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:04.103551 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:04.104321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:04.104754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:04.168009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ff86dc9e-6787-41fd-8069-7a2f033a2420 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 38202 microversion: 2.1 time: 0.082013 Nov 10 16:31:04.168660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1136/2308] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:31:04 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 38202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:31:05.184410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:05.185677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:05.196502 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:05.197164 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:05.198379 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:05.199001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:05.264956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6a0ba413-ef13-4df6-b4bb-8ec0ccc5e203 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 38202 microversion: 2.1 time: 0.086378 Nov 10 16:31:05.265610 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1173/2309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:31:05 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 38202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:31:06.279633 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:06.280556 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:06.288163 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:06.288607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:06.289382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:06.289789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:06.361588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-081e9a8f-b2cd-4b1d-97ea-ee6816c9bfa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action" status: 200 len: 38333 microversion: 2.1 time: 0.085925 Nov 10 16:31:06.362257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1137/2310] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:31:06 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/action => generated 38333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 10 16:31:06.373591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:06.374188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:06.382058 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:06.382554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:06.383419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:06.384349 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:06.409787 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-be4fc059-b5c7-4943-9c2b-07ebd8c8e2dd tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/ips" status: 200 len: 145 microversion: 2.1 time: 0.040242 Nov 10 16:31:06.410418 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1174/2311] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Nov 10 16:31:06 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:07.755794 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c426984-297f-4a33-8ef7-5901bd53f9d1"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:07.756955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:07.764178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:07.764622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:07.765388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:07.765817 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:08.042574 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f628e722-b45e-4d2b-9112-1db6aa4b0828 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290315 Nov 10 16:31:08.043399 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1138/2312] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 16:31:07 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:14.516483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:14.517407 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:14.524220 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:14.524668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:14.525442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:14.525881 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:14.560546 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e69a43e6-6e6e-472b-b3c5-75c427267792 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Nov 10 16:31:14.561105 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1175/2313] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:31:14 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:14.572052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:14.572621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:14.579216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:14.579650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:14.580412 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:14.580837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:14.616837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c6629a53-33c3-42ab-ac14-fa00373a0ad9 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1" status: 200 len: 194 microversion: 2.1 time: 0.049241 Nov 10 16:31:14.617439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1139/2314] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Nov 10 16:31:14 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:15.938045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "028648c3-e6d5-4cbe-a48e-93b0d094ddda"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:15.941682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:15.948669 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:15.949122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:15.949904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:15.950357 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:16.203681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bb852729-e167-4c7c-b648-b5c7928a3222 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272328 Nov 10 16:31:16.204615 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1176/2315] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 16:31:15 2021] POST /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:24.788238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:24.789167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:24.796271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:24.796706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:24.797495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:24.797908 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:24.828864 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-592b0ec8-37f2-4b65-a165-c3ec7af005d8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044416 Nov 10 16:31:24.829467 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1140/2316] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:31:24 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:25.685090 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:25.686428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:25.697409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:25.698145 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:25.699534 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:25.700262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:25.735073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-bdfc3c34-62b9-45dc-bcb0-9f79cd68de91 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1" status: 200 len: 194 microversion: 2.1 time: 0.058038 Nov 10 16:31:25.735679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1177/2317] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Nov 10 16:31:25 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:25.748462 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:25.748947 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:25.756088 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:25.756525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:25.757287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:25.757705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:25.846082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lazy-loading 'services' on Instance uuid 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:31:25.923961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a684e8ab-97a1-409f-ba45-87cc32e98ed4 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1" status: 202 len: 0 microversion: 2.1 time: 0.179223 Nov 10 16:31:25.924549 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1141/2318] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:31:25 2021] DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/9c426984-297f-4a33-8ef7-5901bd53f9d1 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:31:29.143935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:29.144472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:29.151367 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:29.151840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:29.152593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:29.153034 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:29.183641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-c760b257-b3b3-41b2-81c3-50c2653bd3ec tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/028648c3-e6d5-4cbe-a48e-93b0d094ddda" status: 200 len: 194 microversion: 2.1 time: 0.043727 Nov 10 16:31:29.184214 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1178/2319] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Nov 10 16:31:29 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/028648c3-e6d5-4cbe-a48e-93b0d094ddda => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:29.195109 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:29.195660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:29.202449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:29.202974 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:29.203744 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:29.204168 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:29.285816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lazy-loading 'services' on Instance uuid 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:31:29.357460 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-771f19bb-06b1-4b82-966d-ec0914129341 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/028648c3-e6d5-4cbe-a48e-93b0d094ddda" status: 202 len: 0 microversion: 2.1 time: 0.166734 Nov 10 16:31:29.357978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1142/2320] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:31:29 2021] DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments/028648c3-e6d5-4cbe-a48e-93b0d094ddda => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:31:30.532785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:30.533711 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:30.540643 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.541124 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.541889 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.542428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.571497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e9356b6e-e5ba-4adf-aa4c-d3b5372d44f7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042601 Nov 10 16:31:30.572040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1179/2321] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:31:30 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:31:30.689155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:30.690063 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:30.696811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.697254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.698027 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.698487 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.729201 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56e8d677-e7cd-40e7-99ef-e99e708b893d tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050380 Nov 10 16:31:30.730011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1143/2322] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:31:30 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:31:30.797085 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:30.797600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:30.804221 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.804671 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.805449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.805886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.833030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:31:30.919317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-86ab3090-8bca-4291-9d5a-e684a08fbd25 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 204 len: 0 microversion: 2.1 time: 0.128011 Nov 10 16:31:30.920079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1180/2323] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:31:30 2021] DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:31:30.928677 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:30.929280 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:30.935668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.936122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:30.936893 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:30.937349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:31.083083 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:31.092877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d0ff3898-3b90-4c15-ac01-705db0f3faa6 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1673 microversion: 2.1 time: 0.167845 Nov 10 16:31:31.093485 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1144/2324] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:30 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:32.114957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:32.116440 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:32.127320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:32.128185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:32.129480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:32.130215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:32.272730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:32.280674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-63b2ce2c-3fd0-4c49-bed8-8102350bc4b8 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1673 microversion: 2.1 time: 0.172367 Nov 10 16:31:32.281449 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1181/2325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:32 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:33.302219 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:33.303216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:33.313476 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:33.313924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:33.314737 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:33.315166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:33.453061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:33.464396 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d8300ba9-4a26-48bc-b8c5-54176e5ac522 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1673 microversion: 2.1 time: 0.168093 Nov 10 16:31:33.466455 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1145/2326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:33 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:34.483648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:34.484396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:34.491278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:34.491730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:34.493025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:34.493461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:34.637677 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:34.645465 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-90c70ad2-bb72-45f9-96e1-f8a0b64b08ac tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1673 microversion: 2.1 time: 0.167222 Nov 10 16:31:34.646032 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1182/2327] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:34 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:35.661862 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:35.662925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:35.669108 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:35.669552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:35.670354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:35.670785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:35.733060 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:35.741242 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c75bb061-b7e9-418f-ac79-f910ce06cd6f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1605 microversion: 2.1 time: 0.083059 Nov 10 16:31:35.741832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1146/2328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:35 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1605 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:35.857710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-7fad1792-bc60-4228-8ac7-9f60d5d8db0b req-0a3bd29f-b3c5-4e08-bbb8-16a4cebded0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e", "name": "network-vif-deleted", "tag": "7d60208b-12de-4927-b2c1-fe03c2f42c2b"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:31:35.859601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:31:35.859601 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:31:35.867346 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7fad1792-bc60-4228-8ac7-9f60d5d8db0b req-0a3bd29f-b3c5-4e08-bbb8-16a4cebded0c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:35.867782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7fad1792-bc60-4228-8ac7-9f60d5d8db0b req-0a3bd29f-b3c5-4e08-bbb8-16a4cebded0c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:35.885951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-7fad1792-bc60-4228-8ac7-9f60d5d8db0b req-0a3bd29f-b3c5-4e08-bbb8-16a4cebded0c service nova] Creating event network-vif-deleted:7d60208b-12de-4927-b2c1-fe03c2f42c2b for instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e on hv-cinder-81708 Nov 10 16:31:35.894008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-7fad1792-bc60-4228-8ac7-9f60d5d8db0b req-0a3bd29f-b3c5-4e08-bbb8-16a4cebded0c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039948 Nov 10 16:31:35.894662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1183/2329] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:31:36.759073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:36.759685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:36.766539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:36.766992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:36.767776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:36.768213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:36.800525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:36.800886 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:36.801327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lazy-loading 'fault' on Instance uuid 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:31:36.841937 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:36.849988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b6fb7f7e-3982-4dd1-9ca0-e2425fa9c607 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1327 microversion: 2.1 time: 0.094827 Nov 10 16:31:36.850595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1147/2330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:36 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:37.869361 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:37.870038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:37.876500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:37.877154 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:37.877951 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:37.878436 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:37.910691 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:37.911083 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:37.911513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lazy-loading 'fault' on Instance uuid 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:31:37.958365 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865802b111a42118b385d68fb89f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f86f93bf80849ffadb5e07891102ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:31:37.966409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e9b03f9a-9ee8-4a5c-8dde-7166e4d1d73c tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 200 len: 1327 microversion: 2.1 time: 0.102043 Nov 10 16:31:37.966981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1184/2331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:37 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:31:38.985277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:38.985929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:38.992775 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:38.993246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:38.994025 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:38.994486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:39.008822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. Nov 10 16:31:39.009416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:31:39.010283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5710253d-19a9-42d8-9847-f5f1467c932f tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 404 len: 111 microversion: 2.1 time: 0.028986 Nov 10 16:31:39.010801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1148/2332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:38 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:31:39.020653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-67cb815a-b199-491d-97eb-ae10dca1a633 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '.version_select at 0x7faa9b7ed430>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:39.040856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-67cb815a-b199-491d-97eb-ae10dca1a633 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669491886" status: 202 len: 0 microversion: 2.1 time: 0.025147 Nov 10 16:31:39.041406 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1185/2333] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Nov 10 16:31:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669491886 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:31:41.972586 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:41.973139 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:41.979768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:41.980214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:41.980977 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:41.981403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:41.995340 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. Nov 10 16:31:41.995939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:31:41.996771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1e2a9b88-d65f-464d-8f6e-2b4a98f79a47 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 404 len: 111 microversion: 2.1 time: 0.028002 Nov 10 16:31:41.997284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1149/2334] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:31:41 2021] DELETE /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:31:42.005956 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:42.006573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:42.012793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:42.013244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:42.014013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:42.014482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:42.029626 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. Nov 10 16:31:42.030222 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:31:42.031060 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-95ebeda2-3000-422e-a303-73e464b31508 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e" status: 404 len: 111 microversion: 2.1 time: 0.029444 Nov 10 16:31:42.031582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1186/2335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:42 2021] GET /compute/v2.1/servers/1e6ebfb4-f4d3-4eb1-af4f-d82319f94f9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:31:45.281632 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:45.282141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:45.288916 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:45.289360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:45.290127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:45.290597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:45.304350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. Nov 10 16:31:45.304933 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:31:45.305807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c14a9124-f01f-4939-a3c8-c5d5e197b2b7 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 404 len: 111 microversion: 2.1 time: 0.027962 Nov 10 16:31:45.306378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1150/2336] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:31:45 2021] DELETE /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:31:45.314561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:31:45.315174 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] [instance: 411c29a5-496c-4064-a314-d21bd0293673] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:31:45.321998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:45.322477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:45.323278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:31:45.323681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:31:45.337447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] HTTP exception thrown: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. Nov 10 16:31:45.338040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] Returning 404 to user: Instance 411c29a5-496c-4064-a314-d21bd0293673 could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:31:45.338895 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-602fc106-7bdc-46c2-a58b-0fa325c9e984 tempest-AttachVolumeTestJSON-988856774 tempest-AttachVolumeTestJSON-988856774-project] 10.222.0.60 "GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673" status: 404 len: 111 microversion: 2.1 time: 0.028325 Nov 10 16:31:45.339443 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1187/2337] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:31:45 2021] GET /compute/v2.1/servers/411c29a5-496c-4064-a314-d21bd0293673 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:32:18.742112 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Action: 'create', calling method: .version_select at 0x7faaad052ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1422066139"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:18.756271 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:18.760175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for user 08f2f94c57ce4d2a907db09a7e1398b4 and project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:18.930660 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:18.934768 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for user 08f2f94c57ce4d2a907db09a7e1398b4 and project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:18.948840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-86d809a7-dca2-4b4e-9b21-39f563e7d50a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.449241 Nov 10 16:32:18.949408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1151/2338] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Nov 10 16:32:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:32:39.845276 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-660662184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1422066139", "security_groups": [{"name": "tempest-secgroup-smoke-655734352"}], "block_device_mapping_v2": [{"uuid": "4708434d-2732-4c2e-80ba-398e97a054da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "683153d4-4bbe-4c82-948e-c074d14496a4"}]}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:40.180831 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] validate_networks() for [('683153d4-4bbe-4c82-948e-c074d14496a4', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:32:40.661528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:32:40.661980 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:32:40.662482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:32:40.663041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:32:40.663462 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:32:40.678982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:40.679421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:40.680212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:40.680637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:40.698862 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:40.703013 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for user 08f2f94c57ce4d2a907db09a7e1398b4 and project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:40.764030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:32:40.766218 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4708434d-2732-4c2e-80ba-398e97a054da',volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:32:40.905308 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: ERROR oslo.messaging._drivers.impl_rabbit [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [979ce3f1-ab8f-4392-b197-d13bd280da3b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 10 16:32:41.926627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [979ce3f1-ab8f-4392-b197-d13bd280da3b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33444. Nov 10 16:32:41.932648 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-88665be9-5adc-4fba-9d3f-51de18f95df1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.090947 Nov 10 16:32:41.933627 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1188/2339] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:32:39 2021] POST /compute/v2.1/servers => generated 405 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:32:41.947803 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d9d536ab-09c2-4378-8f06-dd11e2f40485 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:41.949048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d9d536ab-09c2-4378-8f06-dd11e2f40485 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:42.362559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d9d536ab-09c2-4378-8f06-dd11e2f40485 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:42.371874 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d9d536ab-09c2-4378-8f06-dd11e2f40485 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1094 microversion: 2.1 time: 0.430745 Nov 10 16:32:42.373449 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1152/2340] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:41 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1094 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:43.389471 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:43.390093 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:43.398898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:43.399358 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:43.400165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:43.400600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:43.603441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:43.621380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f5e1082a-9c59-43ad-924d-e16c275e2cd2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1210 microversion: 2.1 time: 0.233601 Nov 10 16:32:43.621990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1189/2341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:43 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:44.638837 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:44.640090 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:44.651645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:44.652443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:44.654506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:44.657676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:44.917559 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:44.927926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ab1e5782-9fe3-4863-b5d9-0daf2f0576d3 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.293289 Nov 10 16:32:44.940257 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1153/2342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:44 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:45.556250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-18720b2e-bd1a-4594-8864-f8d4537f396c req-f69c43c8-0792-488d-b80b-40c844fdaf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec1180-85f3-44ca-882a-5a667326ab9e", "tag": "2f101c06-cfd5-42f8-9144-9fe83b0e2739"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:45.561513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:32:45.561513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:32:45.578925 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-18720b2e-bd1a-4594-8864-f8d4537f396c req-f69c43c8-0792-488d-b80b-40c844fdaf23 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:45.579880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-18720b2e-bd1a-4594-8864-f8d4537f396c req-f69c43c8-0792-488d-b80b-40c844fdaf23 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:45.596170 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-18720b2e-bd1a-4594-8864-f8d4537f396c req-f69c43c8-0792-488d-b80b-40c844fdaf23 service nova] Creating event network-changed:2f101c06-cfd5-42f8-9144-9fe83b0e2739 for instance 55ec1180-85f3-44ca-882a-5a667326ab9e on hv-cinder-81708 Nov 10 16:32:45.603775 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-18720b2e-bd1a-4594-8864-f8d4537f396c req-f69c43c8-0792-488d-b80b-40c844fdaf23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055207 Nov 10 16:32:45.623758 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1190/2343] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:32:45.962364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:45.963758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:45.972284 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:45.972814 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:45.973879 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:45.974940 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:46.326895 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:46.339597 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b7077311-a6f1-42ce-8c05-9aa0cda42101 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.396862 Nov 10 16:32:46.340571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1154/2344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:45 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:47.357522 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:47.358649 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:47.366409 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:47.366861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:47.367654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:47.368087 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:47.565694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:47.579173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-77ad9ac8-6171-4ab0-8afb-836e82d85699 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.225530 Nov 10 16:32:47.580416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1191/2345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:47 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:48.596003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:48.596631 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:48.603906 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:48.604543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:48.605319 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:48.608056 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:48.783961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:48.792644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e8e58f60-1d9a-4ba6-b60d-5a2085316784 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.200176 Nov 10 16:32:48.802181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1155/2346] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:48 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:49.809776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:49.810381 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:49.820069 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:49.820898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:49.821904 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:49.822573 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:49.991528 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:50.001161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cb694c56-55f0-4afc-9f9d-809a935a146a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.195721 Nov 10 16:32:50.004008 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1192/2347] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:49 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:51.028334 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:51.029642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:51.036726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:51.037327 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:51.038428 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:51.040903 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:51.236381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:51.254622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a81b4118-c882-43be-b2b7-260c326e4c8a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.238037 Nov 10 16:32:51.257329 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1156/2348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:51 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:52.272803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:52.274068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:52.281524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:52.282269 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:52.283248 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:52.283833 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:52.454839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:52.462390 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cada3c5f-d4c1-4e1f-907a-ae6a555f0b50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.194500 Nov 10 16:32:52.463320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1193/2349] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:52 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:32:53.479766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:53.481069 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:53.493510 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:53.494373 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:53.495668 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:53.500571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:53.648847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:53.657072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-951a984b-3ccd-4a6e-8e12-eac2cc155a9c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.181025 Nov 10 16:32:53.657674 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1157/2350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:53 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:54.673322 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:54.674636 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:54.681246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:54.682117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:54.682976 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:54.683410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:54.829197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:54.837384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-360e2e44-9702-4906-ad38-26f795deafe5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.167756 Nov 10 16:32:54.838300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1194/2351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:54 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:55.462351 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-d036619e-f493-4794-bd3c-7ae92c0697f5 req-8bd5e3d9-b6d8-46db-9d09-f764e0066c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ec1180-85f3-44ca-882a-5a667326ab9e", "name": "network-vif-plugged", "status": "completed", "tag": "2f101c06-cfd5-42f8-9144-9fe83b0e2739"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:55.466650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:32:55.466650 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:32:55.478571 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d036619e-f493-4794-bd3c-7ae92c0697f5 req-8bd5e3d9-b6d8-46db-9d09-f764e0066c87 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:55.479278 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-d036619e-f493-4794-bd3c-7ae92c0697f5 req-8bd5e3d9-b6d8-46db-9d09-f764e0066c87 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:55.495932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-d036619e-f493-4794-bd3c-7ae92c0697f5 req-8bd5e3d9-b6d8-46db-9d09-f764e0066c87 service nova] Creating event network-vif-plugged:2f101c06-cfd5-42f8-9144-9fe83b0e2739 for instance 55ec1180-85f3-44ca-882a-5a667326ab9e on hv-cinder-81708 Nov 10 16:32:55.501985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-d036619e-f493-4794-bd3c-7ae92c0697f5 req-8bd5e3d9-b6d8-46db-9d09-f764e0066c87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044422 Nov 10 16:32:55.503285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1158/2352] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:32:55.854739 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:55.855411 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:55.865212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:55.871315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:55.871315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:55.871315 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:56.017978 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:56.025774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-950d383a-349a-426f-b315-ef4e8093d5c6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1265 microversion: 2.1 time: 0.174868 Nov 10 16:32:56.035392 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1195/2353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:55 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:56.429183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'create', calling method: .version_select at 0x7faaa86695e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-258724269"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:56.443059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for project ad5f5b685739474d8b7d172780b85bcc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:56.447296 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for user 29ec7c375fa5465f867ec8f46c7dc484 and project ad5f5b685739474d8b7d172780b85bcc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:56.618518 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for project ad5f5b685739474d8b7d172780b85bcc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:56.622117 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for user 29ec7c375fa5465f867ec8f46c7dc484 and project ad5f5b685739474d8b7d172780b85bcc. Resources: {'key_pairs'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:56.635529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8bc2b77b-4608-4f96-8b3c-11cbe44018af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.210546 Nov 10 16:32:56.636086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1159/2354] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Nov 10 16:32:56 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:56.687160 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-514478619", "imageRef": "55faaa1f-89ac-47b0-b0c3-6290509db105", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-258724269", "networks": [{"uuid": "4b73d8ec-9a69-4822-a63d-ac146c6cf1e6"}]}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:56.739193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] validate_networks() for [('4b73d8ec-9a69-4822-a63d-ac146c6cf1e6', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:32:57.042720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:57.043558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:57.049592 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.050038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.050889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.051316 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.137959 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:32:57.138536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:32:57.138886 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:32:57.139295 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:32:57.139715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:32:57.149530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.149990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.150837 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.151273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.171082 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for project ad5f5b685739474d8b7d172780b85bcc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:32:57.175549 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Getting quotas for user 29ec7c375fa5465f867ec8f46c7dc484 and project ad5f5b685739474d8b7d172780b85bcc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:32:57.186991 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:32:57.189385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55faaa1f-89ac-47b0-b0c3-6290509db105',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:32:57.207468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:57.219880 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0df65904-fa2f-4d22-81a5-f0d21d39b53b tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1451 microversion: 2.1 time: 0.180947 Nov 10 16:32:57.220659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1160/2355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:57 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:32:57.237790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:57.238802 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:57.242503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0754605c-ec77-4c0d-953e-2e1b20905c7a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558918 Nov 10 16:32:57.243244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1196/2356] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:32:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:32:57.251985 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.252662 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.253287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-abca3fd3-48fc-47d4-927d-512fd3602f03 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:57.253598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:57.254030 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:57.254130 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-abca3fd3-48fc-47d4-927d-512fd3602f03 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:57.322817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-abca3fd3-48fc-47d4-927d-512fd3602f03 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:57.330299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-abca3fd3-48fc-47d4-927d-512fd3602f03 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1257 microversion: 2.1 time: 0.080732 Nov 10 16:32:57.331115 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1197/2357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:57 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:32:57.415359 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:57.424085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-2f5fc3ff-1740-419a-ae08-9b09f0a43669 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1451 microversion: 2.1 time: 0.189537 Nov 10 16:32:57.425761 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1161/2358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:57 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:32:58.350152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:58.351511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:58.360718 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:58.361253 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:58.362074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:58.362583 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:58.640686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:58.651320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3757925b-a2b7-410a-b0ec-8ae72c5231df tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1315 microversion: 2.1 time: 0.305810 Nov 10 16:32:58.652230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1198/2359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:58 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:32:59.670381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:32:59.671138 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:32:59.677989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:59.679048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:59.679969 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:59.680446 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:59.786931 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-7075d305-f1e2-4ac7-9c94-c5b27ef62a72 req-77b51414-7994-4285-b5fc-dc17999983e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ec1180-85f3-44ca-882a-5a667326ab9e", "tag": "2f101c06-cfd5-42f8-9144-9fe83b0e2739"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:32:59.789359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:32:59.789359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:32:59.797785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7075d305-f1e2-4ac7-9c94-c5b27ef62a72 req-77b51414-7994-4285-b5fc-dc17999983e1 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:32:59.801259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-7075d305-f1e2-4ac7-9c94-c5b27ef62a72 req-77b51414-7994-4285-b5fc-dc17999983e1 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:32:59.821353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-7075d305-f1e2-4ac7-9c94-c5b27ef62a72 req-77b51414-7994-4285-b5fc-dc17999983e1 service nova] Creating event network-changed:2f101c06-cfd5-42f8-9144-9fe83b0e2739 for instance 55ec1180-85f3-44ca-882a-5a667326ab9e on hv-cinder-81708 Nov 10 16:32:59.827387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-7075d305-f1e2-4ac7-9c94-c5b27ef62a72 req-77b51414-7994-4285-b5fc-dc17999983e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044015 Nov 10 16:32:59.828355 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1199/2360] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:32:59.871875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:32:59.879850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-54f15a63-7163-4f34-b534-e3d94901fcfd tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.214374 Nov 10 16:32:59.880544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1162/2361] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:32:59 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:00.899152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:00.899755 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:00.907228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:00.907697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:00.908500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:00.908941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:01.089106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:01.105128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-89175a99-67d0-4bd9-9b83-2d09bbe3896d tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.211148 Nov 10 16:33:01.115380 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1200/2362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:00 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:02.121852 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:02.122542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:02.129294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:02.129752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:02.130573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:02.130975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:02.276012 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:02.283926 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-74438ead-18f5-457b-adc9-71d4c4049725 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.165733 Nov 10 16:33:02.293350 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1163/2363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:02 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:03.300974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:03.301600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:03.308563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:03.308988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:03.309783 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:03.310228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:03.449806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:03.458209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1c548302-e84f-4364-a291-a24e8641c6bc tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.161010 Nov 10 16:33:03.458872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1201/2364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:03 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:04.483243 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:04.485851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:04.496218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:04.496706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:04.497645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:04.498065 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:04.646696 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:04.655376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cc1d9108-8627-48ce-821d-c9dbdda802ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.178590 Nov 10 16:33:04.656135 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1164/2365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:04 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:05.445865 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:33:05.446188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:33:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:33:05.682199 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:05.682791 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:05.689091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:05.689537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:05.690366 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:05.690801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:05.831206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:05.838964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-453ea204-ba32-45a3-8e76-0a409ddd6c47 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.161012 Nov 10 16:33:05.839916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1202/2366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:05 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:06.856082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:06.856783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:06.863594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:06.864044 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:06.864806 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:06.865239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:07.011720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:07.019707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e47294af-0ff4-4327-96af-e931029884af tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.167278 Nov 10 16:33:07.020705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1165/2367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:06 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:08.037057 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:08.037937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:08.045744 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:08.046326 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:08.047238 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:08.047741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:08.188693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:08.196806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-41386d45-ae48-42c7-8466-ee5d89d7d8fe tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.163625 Nov 10 16:33:08.197535 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1203/2368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:08 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:09.214622 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:09.216175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:09.223420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:09.223998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:09.224840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:09.225525 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:09.478500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:09.490249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1b410cd8-49e0-4a38-b76c-bb2bd0a5c600 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.279210 Nov 10 16:33:09.491132 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1166/2369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:09 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:09.548900 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-98862c24-1dc3-4417-bf13-127c591307fb req-bd4cf58d-204a-457d-9f09-2914cd1facd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:09.553692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:33:09.553692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:33:09.564139 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-98862c24-1dc3-4417-bf13-127c591307fb req-bd4cf58d-204a-457d-9f09-2914cd1facd2 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:09.565330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-98862c24-1dc3-4417-bf13-127c591307fb req-bd4cf58d-204a-457d-9f09-2914cd1facd2 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:09.581618 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-98862c24-1dc3-4417-bf13-127c591307fb req-bd4cf58d-204a-457d-9f09-2914cd1facd2 service nova] Creating event network-changed:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:33:09.587590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-98862c24-1dc3-4417-bf13-127c591307fb req-bd4cf58d-204a-457d-9f09-2914cd1facd2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046884 Nov 10 16:33:09.588442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1204/2370] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:10.507975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:10.508558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:10.515048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:10.515464 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:10.516253 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:10.516694 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:10.658488 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:10.665812 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-cbe01d10-14a4-48d4-99ac-57ce068f529e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.161890 Nov 10 16:33:10.666489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1167/2371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:10 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:11.683213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:11.683929 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:11.690653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:11.691099 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:11.691870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:11.692298 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:11.839860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:11.848018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d5027b55-b258-4e6a-a840-ae8c8fb8ee86 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.169409 Nov 10 16:33:11.848685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1205/2372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:11 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:33:12.865197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:12.865801 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:12.872337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:12.872783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:12.873550 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:12.873979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:13.019118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:13.026859 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-9b37d8fd-834d-42ca-abf8-157cd6a45165 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.165704 Nov 10 16:33:13.027459 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1168/2373] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:12 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:13.555810 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-c144b7e0-d659-4eae-8acb-ab42ccdc80bc req-64f4fcb2-83e0-4244-8e34-382da3147dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "name": "network-vif-plugged", "status": "completed", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:13.557861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:33:13.557861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:33:13.575600 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-c144b7e0-d659-4eae-8acb-ab42ccdc80bc req-64f4fcb2-83e0-4244-8e34-382da3147dea service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:13.577414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-c144b7e0-d659-4eae-8acb-ab42ccdc80bc req-64f4fcb2-83e0-4244-8e34-382da3147dea service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:13.589941 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-c144b7e0-d659-4eae-8acb-ab42ccdc80bc req-64f4fcb2-83e0-4244-8e34-382da3147dea service nova] Creating event network-vif-plugged:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:33:13.595255 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-c144b7e0-d659-4eae-8acb-ab42ccdc80bc req-64f4fcb2-83e0-4244-8e34-382da3147dea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043490 Nov 10 16:33:13.596117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1206/2374] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:14.048867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:14.049736 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:14.060439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:14.060875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:14.061645 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:14.062061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:14.213979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:14.221939 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-73a7bf26-5ddf-472b-9580-15c8348331d7 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1357 microversion: 2.1 time: 0.179597 Nov 10 16:33:14.222565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1169/2375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:14 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:15.242071 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:15.242927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:15.250553 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.251176 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.252270 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.252828 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.399112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:15.407336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9a339f18-844f-4b48-a06f-9382a4f5cf3b tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1546 microversion: 2.1 time: 0.171740 Nov 10 16:33:15.407899 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1207/2376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:15 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:15.429383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:15.429998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:15.436881 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.437328 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.438094 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.438598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.589646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:15.600789 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-922c5011-3180-4dfb-8659-6730bf9bf6e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1546 microversion: 2.1 time: 0.174729 Nov 10 16:33:15.601477 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1170/2377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:15 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:15.623654 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:15.627163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:33:15.627163 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:33:15.628152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:15.628940 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Searching by: {'deleted': False, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc'} {{(pid=115910) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 10 16:33:15.636463 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.636910 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.637827 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.638299 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.725605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.multi_cell_list [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115910) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 10 16:33:15.819344 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d210cc0d-7fc9-4445-b5b3-cd1ffd473f60 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199282 Nov 10 16:33:15.819849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1208/2378] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Nov 10 16:33:15 2021] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:15.833137 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:15.834066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:15.841783 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.842207 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.842995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:15.843391 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:15.987494 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:15.999347 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e296158d-f431-47bb-b1fc-99563e4c64b5 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1546 microversion: 2.1 time: 0.171907 Nov 10 16:33:15.999943 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1171/2379] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:15 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:17.547030 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5a5aa50-60ea-49d8-90d4-4dbc145c3334"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:17.548117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:17.554936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:17.555387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:17.556157 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:17.556588 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:17.825442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-08fca13e-d890-4747-95f9-497ea4ca88e6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282132 Nov 10 16:33:17.826242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1209/2380] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Nov 10 16:33:17 2021] POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:24.379641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:24.380249 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:24.387405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:24.387849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:24.388612 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:24.389039 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:24.535154 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:24.544022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5d48d3e6-5643-4edb-9a1f-b527439dfea6 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1592 microversion: 2.1 time: 0.168240 Nov 10 16:33:24.544595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1172/2381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:24 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1592 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:26.534495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-ff0eb080-7ac9-40bf-ac7f-ada9f5a7e83c req-38171793-6ec8-4ecc-b1bd-259377aa1d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:26.536097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:33:26.536097 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:33:26.543990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-ff0eb080-7ac9-40bf-ac7f-ada9f5a7e83c req-38171793-6ec8-4ecc-b1bd-259377aa1d1c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:26.544408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-ff0eb080-7ac9-40bf-ac7f-ada9f5a7e83c req-38171793-6ec8-4ecc-b1bd-259377aa1d1c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:26.556912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-ff0eb080-7ac9-40bf-ac7f-ada9f5a7e83c req-38171793-6ec8-4ecc-b1bd-259377aa1d1c service nova] Creating event network-changed:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:33:26.562613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-ff0eb080-7ac9-40bf-ac7f-ada9f5a7e83c req-38171793-6ec8-4ecc-b1bd-259377aa1d1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032572 Nov 10 16:33:26.563265 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1210/2382] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:33:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:27.798540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-625695394"}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:27.799114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:27.806040 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:27.806528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:27.807360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:27.807791 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:27.945037 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.network.security_group_api [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Adding security group 0add817b-faa5-4f5d-8798-e1eac70b8446 to port 29916c86-1319-4acf-a703-deefe6ce0d7a Nov 10 16:33:28.286689 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0968b146-7168-4553-9a16-e024936ab4d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action" status: 202 len: 0 microversion: 2.1 time: 0.492457 Nov 10 16:33:28.287777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1173/2383] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:33:27 2021] POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 10 16:33:28.295830 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:28.299851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:28.301813 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-b7c2c879-8b82-452d-940d-2a00e847cd91 req-202135ca-e4e9-4199-91df-94c12d2cc27b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:28.304613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:33:28.304613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:33:28.310596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:28.311043 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:28.311843 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:28.312281 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:28.317198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b7c2c879-8b82-452d-940d-2a00e847cd91 req-202135ca-e4e9-4199-91df-94c12d2cc27b service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:28.317819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b7c2c879-8b82-452d-940d-2a00e847cd91 req-202135ca-e4e9-4199-91df-94c12d2cc27b service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:28.334252 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-b7c2c879-8b82-452d-940d-2a00e847cd91 req-202135ca-e4e9-4199-91df-94c12d2cc27b service nova] Creating event network-changed:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:33:28.339468 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-b7c2c879-8b82-452d-940d-2a00e847cd91 req-202135ca-e4e9-4199-91df-94c12d2cc27b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046664 Nov 10 16:33:28.340800 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1211/2384] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:33:28.501811 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:28.511976 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-6ceb15cd-cfec-4b65-a978-80c8d372d3d3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1757 microversion: 2.1 time: 0.219722 Nov 10 16:33:28.513252 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1174/2385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:28 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:50.876235 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:33:50.877360 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:50.885197 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:50.885698 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:50.886606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:50.887088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:50.964816 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0d78f597-0e91-46de-acee-698289544919 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action" status: 202 len: 0 microversion: 2.1 time: 0.093018 Nov 10 16:33:50.965505 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1212/2386] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:33:50 2021] POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:33:50.974326 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:50.974979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:50.981700 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:50.982230 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:50.983052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:50.983507 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:51.129941 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:51.140101 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7dde8ef0-e6cc-4081-b9f5-75032ad655bf tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1749 microversion: 2.1 time: 0.169589 Nov 10 16:33:51.140687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1175/2387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:50 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:52.165337 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:52.166582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:52.177690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:52.178512 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:52.180002 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:52.180424 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:52.347570 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:52.355990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0565d580-d7fe-44d5-9214-beabbe3cfcd3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.197613 Nov 10 16:33:52.356559 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1213/2388] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:52 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:53.378081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:53.379165 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:53.388480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:53.388922 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:53.389698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:53.390128 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:53.542539 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:53.551540 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5c3a2810-8588-47d7-87cf-de62233c2677 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.179770 Nov 10 16:33:53.552348 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1176/2389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:53 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:54.573480 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:54.574073 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:54.581236 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:54.581713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:54.582530 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:54.582955 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:54.740525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:54.748552 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-452297ed-2136-44eb-8037-e5073e119a02 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.180859 Nov 10 16:33:54.749118 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1214/2390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:54 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:55.769606 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:55.770618 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:55.779192 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:55.779636 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:55.780407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:55.780839 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:55.942031 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:55.950335 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8e925f7c-096a-4979-9cca-16696775b8ad tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.186931 Nov 10 16:33:55.950875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1177/2391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:55 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:56.970021 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:56.970840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:56.979239 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:56.979697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:56.980478 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:56.980912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:57.137394 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:57.146111 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-870cffdc-9bbc-4d10-9321-35596f47e370 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.181180 Nov 10 16:33:57.146745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1215/2392] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:56 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:58.168169 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:58.168788 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:58.175425 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:58.175876 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:58.176652 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:58.177082 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:58.327721 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:58.336285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-c093cce6-34da-4753-aa2d-998c482860a2 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.174518 Nov 10 16:33:58.336858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1178/2393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:58 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:33:59.356674 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:33:59.357441 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:33:59.366804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:59.367498 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:59.368611 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:33:59.369363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:33:59.534243 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:33:59.542527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2536b916-ded8-498b-9e67-99d1785970ea tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.190971 Nov 10 16:33:59.543106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1216/2394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:33:59 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:00.564365 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:00.565417 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:00.574892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:00.575341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:00.576118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:00.576542 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:00.742577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:00.750978 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5b87bb20-fc03-4028-98e7-e932ec23b366 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.193234 Nov 10 16:34:00.751553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1179/2395] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:00 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:01.767967 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:01.768578 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:01.775848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:01.776281 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:01.777047 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:01.777483 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:01.937211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:01.945822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3e89c487-fa00-4531-be65-9c53c3765299 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1754 microversion: 2.1 time: 0.181801 Nov 10 16:34:01.946450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1217/2396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:01 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:02.964838 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:02.965596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:02.972232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:02.972707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:02.973482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:02.973920 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:03.129809 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:03.142609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1fa62b05-05a0-406f-991d-7a5cf6db4b3e tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1757 microversion: 2.1 time: 0.182023 Nov 10 16:34:03.143420 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1180/2397] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:02 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:35.439421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-625695394"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:34:35.440025 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:35.446511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:35.446962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:35.447753 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:35.448190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:35.584419 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.network.security_group_api [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Removing security group 0add817b-faa5-4f5d-8798-e1eac70b8446 from port 29916c86-1319-4acf-a703-deefe6ce0d7a Nov 10 16:34:35.919921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-3800ef95-9009-4daf-8f96-f13cb988263f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action" status: 202 len: 0 microversion: 2.1 time: 0.486250 Nov 10 16:34:35.921011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1218/2398] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:34:35 2021] POST /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:34:36.027213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-79fb7f0a-c8ca-4c87-a792-0da771039877 req-60b96129-6b22-4bf9-af2d-fe75cc6109ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:34:36.029743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:34:36.029743 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:34:36.037311 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-79fb7f0a-c8ca-4c87-a792-0da771039877 req-60b96129-6b22-4bf9-af2d-fe75cc6109ca service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:36.037901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-79fb7f0a-c8ca-4c87-a792-0da771039877 req-60b96129-6b22-4bf9-af2d-fe75cc6109ca service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:36.052421 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-79fb7f0a-c8ca-4c87-a792-0da771039877 req-60b96129-6b22-4bf9-af2d-fe75cc6109ca service nova] Creating event network-changed:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:34:36.059887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-79fb7f0a-c8ca-4c87-a792-0da771039877 req-60b96129-6b22-4bf9-af2d-fe75cc6109ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130360 Nov 10 16:34:36.064756 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1181/2399] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:34:37.072275 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:37.072803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:37.079259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:37.079713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:37.080525 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:37.080961 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:37.160527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lazy-loading 'services' on Instance uuid 7ac83c62-2c78-4b44-a6a6-ddd1d181198c {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:34:37.236063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ff770758-85b4-4cd3-9b1d-e5d28e26563f tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments/d5a5aa50-60ea-49d8-90d4-4dbc145c3334" status: 202 len: 0 microversion: 2.1 time: 0.167732 Nov 10 16:34:37.236750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1219/2400] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:34:37 2021] DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments/d5a5aa50-60ea-49d8-90d4-4dbc145c3334 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:34:37.249287 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:37.251294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:37.258468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:37.258925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:37.259706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:37.260161 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:37.290125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-e5bdcbbf-94f7-49a4-b1a9-6e736a3f5a28 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Nov 10 16:34:37.290785 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1182/2401] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:34:37 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:34:38.078737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-b6703537-d9df-49ba-bcba-fea783310855 req-e5ca6282-1761-442d-bb4c-6eab1ebca020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:34:38.080288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:34:38.080288 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:34:38.088579 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b6703537-d9df-49ba-bcba-fea783310855 req-e5ca6282-1761-442d-bb4c-6eab1ebca020 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:38.089029 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b6703537-d9df-49ba-bcba-fea783310855 req-e5ca6282-1761-442d-bb4c-6eab1ebca020 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:38.101686 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-b6703537-d9df-49ba-bcba-fea783310855 req-e5ca6282-1761-442d-bb4c-6eab1ebca020 service nova] Creating event network-changed:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:34:38.106558 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-b6703537-d9df-49ba-bcba-fea783310855 req-e5ca6282-1761-442d-bb4c-6eab1ebca020 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Nov 10 16:34:38.107149 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1220/2402] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:34:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 10 16:34:38.302441 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:38.303353 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:38.309950 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:38.310431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:38.311213 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:38.311698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:38.342528 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-44cae8d6-cc52-43e7-97b4-4d461e010f0a tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043843 Nov 10 16:34:38.343122 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1183/2403] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Nov 10 16:34:38 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 10 16:34:38.353590 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:38.354434 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:38.360662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:38.361472 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:38.362278 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:38.362713 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:38.437123 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] HTTP exception thrown: Instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c is not attached to volume d5a5aa50-60ea-49d8-90d4-4dbc145c3334 Nov 10 16:34:38.437836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Returning 404 to user: Instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c is not attached to volume d5a5aa50-60ea-49d8-90d4-4dbc145c3334 {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:34:38.438855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2b5de8e6-8665-4d18-a77a-d492eda61109 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments/d5a5aa50-60ea-49d8-90d4-4dbc145c3334" status: 404 len: 154 microversion: 2.1 time: 0.089509 Nov 10 16:34:38.439416 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1221/2404] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Nov 10 16:34:38 2021] DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c/os-volume_attachments/d5a5aa50-60ea-49d8-90d4-4dbc145c3334 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:34:39.578416 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:39.579174 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:39.585918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:39.586577 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:39.587397 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:39.587875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:39.612720 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:34:39.699777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-839aba9f-6411-4981-bc9f-f808341c9869 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 204 len: 0 microversion: 2.1 time: 0.125141 Nov 10 16:34:39.700560 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1184/2405] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:34:39 2021] DELETE /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:34:39.709302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:39.709908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:39.716325 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:39.716763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:39.717527 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:39.717954 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:39.867763 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:39.876314 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-751ebf2b-0ab5-47b9-a12b-40ecd18eb7d0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1552 microversion: 2.1 time: 0.170923 Nov 10 16:34:39.876875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1222/2406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:39 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:40.899041 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:40.900288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:40.911361 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:40.912099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:40.913384 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:40.914099 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:41.058017 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:41.065651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3aacbce8-13e1-4ea4-bc68-3ce66ad447e3 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1552 microversion: 2.1 time: 0.173512 Nov 10 16:34:41.066211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1185/2407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:40 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:41.872267 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-0b9a48bb-8747-4abd-add8-7822b6060840 req-2567f246-7b37-4972-9a9b-d5a397cc4c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac83c62-2c78-4b44-a6a6-ddd1d181198c", "name": "network-vif-deleted", "tag": "29916c86-1319-4acf-a703-deefe6ce0d7a"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:34:41.873790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:34:41.873790 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:34:41.881678 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0b9a48bb-8747-4abd-add8-7822b6060840 req-2567f246-7b37-4972-9a9b-d5a397cc4c9d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:41.882120 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0b9a48bb-8747-4abd-add8-7822b6060840 req-2567f246-7b37-4972-9a9b-d5a397cc4c9d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:41.897694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-0b9a48bb-8747-4abd-add8-7822b6060840 req-2567f246-7b37-4972-9a9b-d5a397cc4c9d service nova] Creating event network-vif-deleted:29916c86-1319-4acf-a703-deefe6ce0d7a for instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c on hv-cinder-81708 Nov 10 16:34:41.902780 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-0b9a48bb-8747-4abd-add8-7822b6060840 req-2567f246-7b37-4972-9a9b-d5a397cc4c9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034234 Nov 10 16:34:41.903388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1223/2408] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:34:42.085771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:42.086381 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:42.095972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:42.096538 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:42.097480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:42.098072 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:42.137553 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:42.137982 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:42.138481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lazy-loading 'fault' on Instance uuid 7ac83c62-2c78-4b44-a6a6-ddd1d181198c {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:34:42.180220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ec7c375fa5465f867ec8f46c7dc484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5f5b685739474d8b7d172780b85bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:42.188233 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1bf00a35-5c5f-4ab3-af20-412b08cb1af0 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 200 len: 1347 microversion: 2.1 time: 0.108070 Nov 10 16:34:42.188846 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1186/2409] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:42 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:43.206992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:43.207703 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] [instance: 7ac83c62-2c78-4b44-a6a6-ddd1d181198c] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:43.215234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:43.215696 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:43.216488 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:43.216971 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:43.237168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] HTTP exception thrown: Instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c could not be found. Nov 10 16:34:43.237778 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Returning 404 to user: Instance 7ac83c62-2c78-4b44-a6a6-ddd1d181198c could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:34:43.238660 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8c5157e4-eef0-461e-89dc-35df8c8d5185 tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c" status: 404 len: 111 microversion: 2.1 time: 0.037228 Nov 10 16:34:43.239469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1224/2410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:43 2021] GET /compute/v2.1/servers/7ac83c62-2c78-4b44-a6a6-ddd1d181198c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:34:43.247706 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b2d36fa3-77d6-4a15-b0c9-9aa0016cb5ab tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] Calling method '.version_select at 0x7faaa899d3a0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:43.271745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b2d36fa3-77d6-4a15-b0c9-9aa0016cb5ab tempest-TestMinimumBasicScenario-1674120124 tempest-TestMinimumBasicScenario-1674120124-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-258724269" status: 202 len: 0 microversion: 2.1 time: 0.027649 Nov 10 16:34:43.272325 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1187/2411] 10.222.0.60 () {58 vars in 1268 bytes} [Wed Nov 10 16:34:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-258724269 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:34:56.205605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:56.206181 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:56.218273 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:56.218749 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:56.219844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:56.220287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:56.256211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:34:56.345667 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-49d50130-9c98-4895-8746-f38833e039b8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 204 len: 0 microversion: 2.1 time: 0.143430 Nov 10 16:34:56.346413 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1225/2412] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:34:56 2021] DELETE /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:34:56.355500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:56.356103 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:56.364285 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:56.365073 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:56.365972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:56.366300 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:56.529680 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:56.546269 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b058d9b7-31ea-453b-ac88-69f888bcf2a8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1575 microversion: 2.1 time: 0.195117 Nov 10 16:34:56.547870 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1188/2413] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:56 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:57.408231 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:34:57.408921 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:34:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:34:57.566482 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:57.567599 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:57.577078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:57.577539 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:57.578384 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:57.578826 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:58.059526 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:58.073359 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7400e189-1f63-4bb9-b560-f8df9dbcafee tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1575 microversion: 2.1 time: 0.511418 Nov 10 16:34:58.074767 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1226/2414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:57 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1575 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:34:58.970238 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-57e11515-56ba-49b5-abfd-c72b82cd11d5 req-0b014cca-b5e7-4796-bfaf-e948357e0568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ec1180-85f3-44ca-882a-5a667326ab9e", "name": "network-vif-deleted", "tag": "2f101c06-cfd5-42f8-9144-9fe83b0e2739"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:34:58.971822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:34:58.971822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:34:58.995984 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-57e11515-56ba-49b5-abfd-c72b82cd11d5 req-0b014cca-b5e7-4796-bfaf-e948357e0568 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:58.996415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-57e11515-56ba-49b5-abfd-c72b82cd11d5 req-0b014cca-b5e7-4796-bfaf-e948357e0568 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:59.015440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-57e11515-56ba-49b5-abfd-c72b82cd11d5 req-0b014cca-b5e7-4796-bfaf-e948357e0568 service nova] Creating event network-vif-deleted:2f101c06-cfd5-42f8-9144-9fe83b0e2739 for instance 55ec1180-85f3-44ca-882a-5a667326ab9e on hv-cinder-81708 Nov 10 16:34:59.029125 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-57e11515-56ba-49b5-abfd-c72b82cd11d5 req-0b014cca-b5e7-4796-bfaf-e948357e0568 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062562 Nov 10 16:34:59.035782 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1189/2415] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:34:59.092630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:34:59.094074 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:34:59.101489 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:59.101942 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:59.108858 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:34:59.109404 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:34:59.274807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:34:59.286188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1b11286e-f2a5-48db-8c86-6196677f017c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 200 len: 1225 microversion: 2.1 time: 0.198178 Nov 10 16:34:59.287048 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1227/2416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:34:59 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:00.306486 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:00.307904 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:00.319569 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:00.320009 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:00.320813 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:00.326816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:00.368153 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] HTTP exception thrown: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. Nov 10 16:35:00.368774 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Returning 404 to user: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:35:00.369697 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4dd31687-b367-4d53-9bf2-bae3e89f3017 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 404 len: 111 microversion: 2.1 time: 0.068505 Nov 10 16:35:00.370254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1190/2417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:00 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:35:00.613023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1671816459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1422066139", "security_groups": [{"name": "tempest-secgroup-smoke-655734352"}], "block_device_mapping_v2": [{"uuid": "4708434d-2732-4c2e-80ba-398e97a054da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "683153d4-4bbe-4c82-948e-c074d14496a4"}]}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:00.817807 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] validate_networks() for [('683153d4-4bbe-4c82-948e-c074d14496a4', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:35:01.420495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:35:01.420908 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:35:01.421387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:35:01.421854 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:35:01.422330 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:35:01.442213 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:01.443989 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:01.445702 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:01.453244 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:01.520797 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:35:01.532045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for user 08f2f94c57ce4d2a907db09a7e1398b4 and project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:35:01.637818 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:35:01.640056 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4708434d-2732-4c2e-80ba-398e97a054da',volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:35:01.818009 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44831bbe-6674-4831-92d9-6c78875f9cd8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.209121 Nov 10 16:35:01.823742 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1228/2418] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:35:00 2021] POST /compute/v2.1/servers => generated 405 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:35:01.833475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-98267db8-84b6-4497-8537-8e75b944064f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:01.834074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-98267db8-84b6-4497-8537-8e75b944064f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:01.919216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-98267db8-84b6-4497-8537-8e75b944064f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:01.929929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-98267db8-84b6-4497-8537-8e75b944064f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1095 microversion: 2.1 time: 0.099958 Nov 10 16:35:01.931552 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1191/2419] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:01 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:02.693883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Action: 'create', calling method: .version_select at 0x7faa9b755310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1668738720"}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:02.709880 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:35:02.714386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for user d9490a34b4f24bf7aaac71813e784fb1 and project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:35:02.948130 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:02.948763 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:02.969342 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:02.969835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:02.970687 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:02.971114 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:02.978018 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:35:02.982433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for user d9490a34b4f24bf7aaac71813e784fb1 and project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'key_pairs'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:35:02.998503 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d80b52eb-fe74-4d95-b555-32b4a990b924 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.545487 Nov 10 16:35:02.999352 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1229/2420] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Nov 10 16:35:02 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:03.051638 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:03.062957 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-40c32a26-1d45-4937-be79-7f478cde2172 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1201 microversion: 2.1 time: 0.118382 Nov 10 16:35:03.063808 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1192/2421] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:02 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:35:04.081902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:04.083401 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:04.091320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:04.093486 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:04.094372 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:04.094985 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:04.382226 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:04.397500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-8dae5a52-61a6-4aeb-acdb-aa4dfa699f43 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.319905 Nov 10 16:35:04.402689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1230/2422] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:04 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:04.888474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-c4689e97-6b6d-48fd-9b9e-f3c245c51aa6 req-3abb0529-2452-48dd-88f5-5b7d35fa2bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640e6279-0099-4248-88ff-1f648b326504", "tag": "b9b9fbaa-5677-49dd-9654-90a164b0d4d2"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:04.890059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:04.890059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:35:04.906956 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-c4689e97-6b6d-48fd-9b9e-f3c245c51aa6 req-3abb0529-2452-48dd-88f5-5b7d35fa2bda service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:04.907915 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-c4689e97-6b6d-48fd-9b9e-f3c245c51aa6 req-3abb0529-2452-48dd-88f5-5b7d35fa2bda service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:04.933382 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-c4689e97-6b6d-48fd-9b9e-f3c245c51aa6 req-3abb0529-2452-48dd-88f5-5b7d35fa2bda service nova] Creating event network-changed:b9b9fbaa-5677-49dd-9654-90a164b0d4d2 for instance 640e6279-0099-4248-88ff-1f648b326504 on hv-cinder-81708 Nov 10 16:35:04.943588 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-c4689e97-6b6d-48fd-9b9e-f3c245c51aa6 req-3abb0529-2452-48dd-88f5-5b7d35fa2bda service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058110 Nov 10 16:35:04.945900 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1193/2423] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:35:05.420450 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:05.420982 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:05.427343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:05.428066 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:05.428870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:05.429297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:05.571258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:05.578685 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0047907c-e7d8-4111-b798-2fab2e6d0304 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.162504 Nov 10 16:35:05.579234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1231/2424] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:05 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:06.596643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:06.597331 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:06.604719 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:06.605475 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:06.606725 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:06.610967 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:06.763118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:06.772214 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-fa01f716-2a2c-405a-b63f-d4d6a30ecfca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.180014 Nov 10 16:35:06.772807 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1194/2425] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:06 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:07.792770 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:07.793477 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:07.800641 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:07.801088 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:07.801857 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:07.802340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:07.951421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:07.959625 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-44ddf5b1-95e7-4821-881f-30c39cc92ab4 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.170931 Nov 10 16:35:07.960179 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1232/2426] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:07 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:08.975911 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:08.976474 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:08.982923 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:08.983370 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:08.984136 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:08.984570 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:09.132492 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:09.140011 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ed72e562-1d30-49d4-87dc-0114d4b3081a tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.167882 Nov 10 16:35:09.140562 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1195/2427] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:08 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:10.160658 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:10.161492 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:10.169104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:10.169569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:10.170916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:10.171297 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:10.310354 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:10.318839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2bed5391-d52e-4c73-920b-e204cb047656 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.164417 Nov 10 16:35:10.320217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1233/2428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:10 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:11.338283 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:11.338919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:11.345424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:11.345861 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:11.346666 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:11.347087 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:11.496647 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:11.507758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8d4d498b-7979-47eb-a141-cc4f866a317c tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.173759 Nov 10 16:35:11.508565 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1196/2429] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:11 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:12.525258 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:12.525841 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:12.532593 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:12.533045 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:12.533819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:12.534287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:12.682776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:12.691190 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-87bd689c-6275-42b1-83fc-440467d9d8d8 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.169945 Nov 10 16:35:12.691860 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1234/2430] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:12 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:13.712224 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:13.713167 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:13.720709 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:13.721159 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:13.721932 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:13.722388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:13.885376 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:13.894354 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d1dd8f59-ea25-4a5f-965a-737553fecfa2 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.188369 Nov 10 16:35:13.895133 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1197/2431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:13 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:14.203317 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-97db5bd4-ebb3-4aca-9c56-de331d7eb60b req-1df04a75-90e9-4d14-9190-c125e4840eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640e6279-0099-4248-88ff-1f648b326504", "name": "network-vif-plugged", "status": "completed", "tag": "b9b9fbaa-5677-49dd-9654-90a164b0d4d2"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:14.204934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:14.204934 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:35:14.212435 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-97db5bd4-ebb3-4aca-9c56-de331d7eb60b req-1df04a75-90e9-4d14-9190-c125e4840eea service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:14.212974 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-97db5bd4-ebb3-4aca-9c56-de331d7eb60b req-1df04a75-90e9-4d14-9190-c125e4840eea service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:14.232681 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-97db5bd4-ebb3-4aca-9c56-de331d7eb60b req-1df04a75-90e9-4d14-9190-c125e4840eea service nova] Creating event network-vif-plugged:b9b9fbaa-5677-49dd-9654-90a164b0d4d2 for instance 640e6279-0099-4248-88ff-1f648b326504 on hv-cinder-81708 Nov 10 16:35:14.238728 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-97db5bd4-ebb3-4aca-9c56-de331d7eb60b req-1df04a75-90e9-4d14-9190-c125e4840eea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 Nov 10 16:35:14.239320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1235/2432] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:35:14.920537 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:14.921766 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:14.930945 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:14.931673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:14.933078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:14.933609 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:15.077439 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:15.085288 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f210cd8c-1a73-4460-8bec-184bb15ddc01 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1266 microversion: 2.1 time: 0.172085 Nov 10 16:35:15.085868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1198/2433] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:14 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:16.107495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:16.108228 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:16.115303 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:16.115754 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:16.116519 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:16.116957 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:16.261428 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:16.269962 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9ffb82a9-abc6-4552-9f39-b99f4a323343 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1452 microversion: 2.1 time: 0.169128 Nov 10 16:35:16.270572 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1236/2434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:16 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:16.287175 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:16.287779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:16.294684 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:16.295256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:16.295891 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:16.296306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:16.606408 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:16.616038 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f5c7ee5a-d9ee-4a2d-b77c-d7021823ab32 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1452 microversion: 2.1 time: 0.332754 Nov 10 16:35:16.616584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1199/2435] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:16 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1452 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:18.570689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-cc658b1a-91e2-4668-9e7c-42274a550758 req-f9837c9f-0406-4362-99f0-a49f47c6ef48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640e6279-0099-4248-88ff-1f648b326504", "tag": "b9b9fbaa-5677-49dd-9654-90a164b0d4d2"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:18.572185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:18.572185 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:35:18.579898 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-cc658b1a-91e2-4668-9e7c-42274a550758 req-f9837c9f-0406-4362-99f0-a49f47c6ef48 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:18.580348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-cc658b1a-91e2-4668-9e7c-42274a550758 req-f9837c9f-0406-4362-99f0-a49f47c6ef48 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:18.591916 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-cc658b1a-91e2-4668-9e7c-42274a550758 req-f9837c9f-0406-4362-99f0-a49f47c6ef48 service nova] Creating event network-changed:b9b9fbaa-5677-49dd-9654-90a164b0d4d2 for instance 640e6279-0099-4248-88ff-1f648b326504 on hv-cinder-81708 Nov 10 16:35:18.597076 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-cc658b1a-91e2-4668-9e7c-42274a550758 req-f9837c9f-0406-4362-99f0-a49f47c6ef48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030414 Nov 10 16:35:18.597690 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1237/2436] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:35:20.723129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-144167251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1668738720", "security_groups": [{"name": "tempest-secgroup-smoke-1354919846"}], "networks": [{"uuid": "19125fe2-ff72-4ab7-95d7-c287abbcb688"}], "block_device_mapping_v2": [{"uuid": "965a7b7d-ecbe-4883-a13c-cee837ccd057", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:20.843217 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.network.neutron [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] validate_networks() for [('19125fe2-ff72-4ab7-95d7-c287abbcb688', None, None, None, None, None)] {{(pid=115911) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:35:21.356453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Flavor limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:35:21.356875 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Image limits 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:35:21.357345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Flavor pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:35:21.357714 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Image pref 0:0:0 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:35:21.358127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.virt.hardware [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:35:21.367491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:21.367930 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:21.368727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:21.369158 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:21.386303 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:35:21.390841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.quota [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Getting quotas for user d9490a34b4f24bf7aaac71813e784fb1 and project 5023a1b11c5d4cc2be900b25146d43d0. Resources: {'cores', 'instances', 'ram'} {{(pid=115911) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:35:21.454534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Going to run 1 instances... {{(pid=115911) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:35:21.456752 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='965a7b7d-ecbe-4883-a13c-cee837ccd057',volume_size=None,volume_type=None)] {{(pid=115911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:35:21.589395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b32f945a-2649-487d-a366-aba22b4cb00d tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.870039 Nov 10 16:35:21.589999 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1200/2437] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:35:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:35:21.603050 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-971a9f1c-b3ad-41ec-b11d-5849a7b18bde tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:21.603748 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-971a9f1c-b3ad-41ec-b11d-5849a7b18bde tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:21.659037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-971a9f1c-b3ad-41ec-b11d-5849a7b18bde tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:21.666287 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-971a9f1c-b3ad-41ec-b11d-5849a7b18bde tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1088 microversion: 2.1 time: 0.067958 Nov 10 16:35:21.666859 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1238/2438] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:21 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:22.686013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:22.687062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:22.696091 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:22.696336 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:22.696925 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:22.697522 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:22.768769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:22.777961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4873674e-66db-4cc6-af6d-10688343a6da tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1194 microversion: 2.1 time: 0.098112 Nov 10 16:35:22.789276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1201/2439] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:22 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:23.799280 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:23.799872 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:23.808809 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:23.809259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:23.810102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:23.810823 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:23.946623 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:23.957518 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d71c3409-9abf-4e2e-948f-21ba928f105b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.161973 Nov 10 16:35:23.958193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1239/2440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:23 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:24.179851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-45e10581-ae6e-4bf4-862e-e79bf32e34b8 req-57076743-f6d6-4e97-93a9-37f4a5d74634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:24.183673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:24.183673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:35:24.192388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-45e10581-ae6e-4bf4-862e-e79bf32e34b8 req-57076743-f6d6-4e97-93a9-37f4a5d74634 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:24.193126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-45e10581-ae6e-4bf4-862e-e79bf32e34b8 req-57076743-f6d6-4e97-93a9-37f4a5d74634 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:24.216516 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-45e10581-ae6e-4bf4-862e-e79bf32e34b8 req-57076743-f6d6-4e97-93a9-37f4a5d74634 service nova] Creating event network-changed:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:35:24.221995 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-45e10581-ae6e-4bf4-862e-e79bf32e34b8 req-57076743-f6d6-4e97-93a9-37f4a5d74634 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046191 Nov 10 16:35:24.226704 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1202/2441] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:35:24.974682 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:24.975309 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:24.981894 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:24.982340 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:24.983650 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:24.984091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:25.123080 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:25.130785 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-66732c1b-23df-4d71-99c9-ae6ff27dab7b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.159902 Nov 10 16:35:25.131408 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1240/2442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:24 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:26.154795 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:26.155849 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:26.163086 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:26.163544 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:26.164341 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:26.164770 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:26.304148 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:26.311792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-8c9c2e78-f30f-439e-b507-5274b2c3d0fe tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.165371 Nov 10 16:35:26.312364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1203/2443] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:26 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:27.332912 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:27.333617 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:27.342965 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:27.343575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:27.344637 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:27.345388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:27.510068 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:27.521793 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7b672888-87e1-4ee3-9d1a-fa0452a0412f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.194160 Nov 10 16:35:27.522576 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1241/2444] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:27 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:28.542998 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:28.543558 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:28.550436 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:28.550892 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:28.551672 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:28.552104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:28.688019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:28.702231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-5d00696c-1225-458a-aa61-0a56c29d9118 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.157717 Nov 10 16:35:28.702858 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1204/2445] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:28 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:29.724524 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:29.725393 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:29.736662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:29.737112 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:29.737875 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:29.738353 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:29.879246 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:29.887165 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-cf664b03-0bda-4c46-aa8d-c32473b790ea tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.169619 Nov 10 16:35:29.887737 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1242/2446] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:29 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:30.908349 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:30.909322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:30.919894 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:30.920629 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:30.921871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:30.922641 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:31.061695 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:31.070067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-f14d148c-1064-4313-adba-710dcab4f200 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.167958 Nov 10 16:35:31.070670 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1205/2447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:30 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:32.090219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:32.091038 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:32.099582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:32.100040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:32.100840 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:32.101284 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:32.239067 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:32.246806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-2c2b2b7e-fee2-4904-9258-db8ea6268b4b tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.162727 Nov 10 16:35:32.247977 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1243/2448] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:32 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:33.264822 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:33.265479 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:33.272968 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:33.273407 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:33.274189 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:33.274634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:33.422901 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:33.430308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-31348cb2-a7cf-403c-8ef4-dd89b7f402cb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.169631 Nov 10 16:35:33.430851 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1206/2449] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:33 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:34.323106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-37e7e59b-0b4a-44c4-901d-aba338329958 req-6685bd8f-508f-4ef9-a47f-8203cc7f48f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "name": "network-vif-plugged", "status": "completed", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:34.324848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:34.324848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:35:34.332370 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-37e7e59b-0b4a-44c4-901d-aba338329958 req-6685bd8f-508f-4ef9-a47f-8203cc7f48f7 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:34.332803 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-37e7e59b-0b4a-44c4-901d-aba338329958 req-6685bd8f-508f-4ef9-a47f-8203cc7f48f7 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:34.344191 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-37e7e59b-0b4a-44c4-901d-aba338329958 req-6685bd8f-508f-4ef9-a47f-8203cc7f48f7 service nova] Creating event network-vif-plugged:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:35:34.349633 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-37e7e59b-0b4a-44c4-901d-aba338329958 req-6685bd8f-508f-4ef9-a47f-8203cc7f48f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091174 Nov 10 16:35:34.350232 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1244/2450] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:35:34.456276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:34.457170 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:34.467211 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:34.467885 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:34.469052 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:34.469681 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:34.606019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:34.614119 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-bf5df11b-5120-4b53-95fb-7e1cce55af8c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.163719 Nov 10 16:35:34.614727 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1207/2451] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:34 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:35.637172 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:35.639193 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:35.647037 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:35.647537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:35.648274 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:35.649356 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:35.797536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:35.808596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-a833b934-66c8-4035-a9c8-b4a84b90dd67 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1260 microversion: 2.1 time: 0.179109 Nov 10 16:35:35.809178 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1245/2452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:35 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:36.829481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:36.830527 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:36.838050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:36.838534 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:36.839306 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:36.839739 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:36.992172 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:36.999726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3950f8d6-53c8-48c5-a2dd-5a59c49c7d25 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1443 microversion: 2.1 time: 0.176428 Nov 10 16:35:37.000308 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1208/2453] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:36 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:37.015935 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:35:37.016554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:35:37.023348 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:37.023806 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:37.024584 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:37.025023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:37.178714 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:35:37.186363 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d2acc381-d40a-4e10-b04c-8f247e61cdc6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1443 microversion: 2.1 time: 0.174080 Nov 10 16:35:37.186943 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1246/2454] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:35:37 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:35:39.300364 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-7ee4dcb6-67ee-4fc1-9ec3-771c339c25af req-772f22cb-41dd-4ba8-8d88-f960345ce129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:35:39.302026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:35:39.302026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:35:39.309166 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-7ee4dcb6-67ee-4fc1-9ec3-771c339c25af req-772f22cb-41dd-4ba8-8d88-f960345ce129 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:35:39.309605 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-7ee4dcb6-67ee-4fc1-9ec3-771c339c25af req-772f22cb-41dd-4ba8-8d88-f960345ce129 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:35:39.320557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-7ee4dcb6-67ee-4fc1-9ec3-771c339c25af req-772f22cb-41dd-4ba8-8d88-f960345ce129 service nova] Creating event network-changed:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:35:39.325716 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-7ee4dcb6-67ee-4fc1-9ec3-771c339c25af req-772f22cb-41dd-4ba8-8d88-f960345ce129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090100 Nov 10 16:35:39.326366 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1209/2455] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:36:54.353529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 10 16:36:54.358613 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1297122211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1422066139", "security_groups": [{"name": "tempest-secgroup-smoke-655734352"}], "block_device_mapping_v2": [{"uuid": "1587d22a-94ef-4384-93ff-12895ece49a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "683153d4-4bbe-4c82-948e-c074d14496a4"}]}} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:36:54.471591 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.network.neutron [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] validate_networks() for [('683153d4-4bbe-4c82-948e-c074d14496a4', None, None, None, None, None)] {{(pid=115910) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 10 16:36:54.941230 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 10 16:36:54.941906 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image limits 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 10 16:36:54.942679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Flavor pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 10 16:36:54.943328 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Image pref 0:0:0 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 10 16:36:54.943986 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.virt.hardware [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 10 16:36:54.957784 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:54.958554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:54.959845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:54.960481 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:54.979237 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 10 16:36:54.983730 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.quota [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Getting quotas for user 08f2f94c57ce4d2a907db09a7e1398b4 and project cb1daf2d99b74460bbd97a9e0b7854fc. Resources: {'cores', 'instances', 'ram'} {{(pid=115910) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 10 16:36:55.043084 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Going to run 1 instances... {{(pid=115910) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 10 16:36:55.045386 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1587d22a-94ef-4384-93ff-12895ece49a1',volume_size=None,volume_type=None)] {{(pid=115910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 10 16:36:55.177640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-09e14d25-200c-48a2-b42e-0fcf5a097df5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.827043 Nov 10 16:36:55.178396 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1247/2456] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Nov 10 16:36:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 10 16:36:55.191453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-1d8543e5-36d7-4729-ab12-2b930cb3cf50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:36:55.192239 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-1d8543e5-36d7-4729-ab12-2b930cb3cf50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:36:55.247623 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-1d8543e5-36d7-4729-ab12-2b930cb3cf50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:36:55.254628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-1d8543e5-36d7-4729-ab12-2b930cb3cf50 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1095 microversion: 2.1 time: 0.069427 Nov 10 16:36:55.255196 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1210/2457] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:36:55 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:36:56.287072 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:36:56.287819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:36:56.295871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:56.296320 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:56.297102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:56.297537 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:56.303335 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec4158c4-b886-4ac2-895c-fa44d7875783] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 34314. Nov 10 16:36:56.364867 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:36:56.373156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fbf67e06-b0fe-456e-8fb2-637cc60d88ca tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1211 microversion: 2.1 time: 0.101062 Nov 10 16:36:56.373768 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1248/2458] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:36:56 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:36:57.391226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:36:57.391818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:36:57.400003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:57.400443 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:57.401232 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:57.401832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:57.548854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:36:57.564705 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b3a12e40-b54f-4d35-93cb-c38ad1895772 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.177464 Nov 10 16:36:57.575979 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1211/2459] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:36:57 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:36:57.584839 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-b064d3ae-0980-4410-a4d7-8636271d213b req-709ccd15-1668-46ce-b35b-b72d18af604d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ffa964-ba4a-45dd-8db7-075b875c47ee", "tag": "09a90f5c-76ef-44b3-8e11-be2e6786d0ae"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:36:57.586487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:36:57.586487 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:36:57.601923 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b064d3ae-0980-4410-a4d7-8636271d213b req-709ccd15-1668-46ce-b35b-b72d18af604d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:57.604506 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-b064d3ae-0980-4410-a4d7-8636271d213b req-709ccd15-1668-46ce-b35b-b72d18af604d service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:57.616883 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-b064d3ae-0980-4410-a4d7-8636271d213b req-709ccd15-1668-46ce-b35b-b72d18af604d service nova] Creating event network-changed:09a90f5c-76ef-44b3-8e11-be2e6786d0ae for instance 61ffa964-ba4a-45dd-8db7-075b875c47ee on hv-cinder-81708 Nov 10 16:36:57.622100 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-b064d3ae-0980-4410-a4d7-8636271d213b req-709ccd15-1668-46ce-b35b-b72d18af604d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040906 Nov 10 16:36:57.623476 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1249/2460] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:36:58.582188 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:36:58.582816 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:36:58.589679 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:58.590126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:58.590958 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:58.591659 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:58.729835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:36:58.738826 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4428dcbd-a8c2-4f8a-98bc-6d6d9942fead tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.160399 Nov 10 16:36:58.739378 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1212/2461] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:36:58 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:36:59.762122 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:36:59.763305 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:36:59.770144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:59.770631 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:59.771414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:36:59.771848 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:36:59.924901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:36:59.936282 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-45cc37f0-171c-44e4-8621-49f654298a6d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.181904 Nov 10 16:36:59.936849 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1250/2462] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:36:59 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:00.955021 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:00.955634 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:00.962400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:00.962835 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:00.963598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:00.964020 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:01.113676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:01.124504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-34774d66-63c3-4acf-9373-4693a7fa4dd5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.174307 Nov 10 16:37:01.125066 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1213/2463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:00 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:02.146043 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:02.147040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:02.156544 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:02.156992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:02.157773 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:02.158217 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:02.306765 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:02.315169 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-682fc7a1-e28b-4bd5-8442-5bc5bdd8f20f tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.175536 Nov 10 16:37:02.315751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1251/2464] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:02 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:03.338975 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:03.339992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:03.350841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:03.351546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:03.352825 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:03.353546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:03.503776 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:03.514854 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b0f67cbf-93c7-4cde-b167-2cc20e1c1202 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.182295 Nov 10 16:37:03.515453 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1214/2465] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:03 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:04.532447 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:04.532995 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:04.539759 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:04.540211 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:04.541001 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:04.541431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:04.702198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:04.709992 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4d37ebb2-3903-420d-bbac-90280d8307d0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.181571 Nov 10 16:37:04.710605 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1252/2466] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:04 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:05.732546 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:05.733164 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:05.739907 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:05.740356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:05.741142 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:05.741596 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:05.885244 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:05.892863 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4eb57a01-250d-4b2d-aae7-13eae77be0c0 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.167119 Nov 10 16:37:05.893427 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1215/2467] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:05 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:06.909901 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:06.910511 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:06.917153 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:06.917598 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:06.918415 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:06.918844 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:07.087788 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:07.096091 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-944f022f-1729-464f-86e4-d3110fc6349d tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.189799 Nov 10 16:37:07.096679 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1253/2468] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:06 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:08.117049 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:08.117988 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:08.126918 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:08.127363 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:08.128144 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:08.128573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:08.268084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:08.275644 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-56055b6e-7f3e-4c72-91cb-8fd11cf387e5 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.164837 Nov 10 16:37:08.276212 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1216/2469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:08 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:08.666078 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-82df7acd-8cd3-44c5-b510-93ad392af062 req-abb780fa-a0ff-418f-8301-655e3ee01e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ffa964-ba4a-45dd-8db7-075b875c47ee", "name": "network-vif-plugged", "status": "completed", "tag": "09a90f5c-76ef-44b3-8e11-be2e6786d0ae"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:37:08.667822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:37:08.667822 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:37:08.676055 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-82df7acd-8cd3-44c5-b510-93ad392af062 req-abb780fa-a0ff-418f-8301-655e3ee01e73 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:08.677283 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-82df7acd-8cd3-44c5-b510-93ad392af062 req-abb780fa-a0ff-418f-8301-655e3ee01e73 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:08.689028 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-82df7acd-8cd3-44c5-b510-93ad392af062 req-abb780fa-a0ff-418f-8301-655e3ee01e73 service nova] Creating event network-vif-plugged:09a90f5c-76ef-44b3-8e11-be2e6786d0ae for instance 61ffa964-ba4a-45dd-8db7-075b875c47ee on hv-cinder-81708 Nov 10 16:37:08.694543 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-82df7acd-8cd3-44c5-b510-93ad392af062 req-abb780fa-a0ff-418f-8301-655e3ee01e73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Nov 10 16:37:08.695414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1254/2470] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:37:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:37:09.294643 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:09.295346 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:09.302111 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:09.302591 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:09.303371 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:09.303790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:09.446702 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:09.455081 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-440cbf3b-f5d9-484c-bc5c-d8efc3e47198 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1266 microversion: 2.1 time: 0.165796 Nov 10 16:37:09.455613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1217/2471] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:09 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:10.476963 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:10.478215 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:10.489168 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:10.489917 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:10.491257 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:10.492019 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:10.635301 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:10.646697 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-ac96e1be-26c0-4155-ac1c-e37df00eae85 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1452 microversion: 2.1 time: 0.176861 Nov 10 16:37:10.647496 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1255/2472] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:10 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:10.665815 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:10.666440 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:10.673146 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:10.673589 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:10.674406 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:10.674960 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:10.823240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:10.831726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-87442998-618d-4e37-803d-62a7e488b6d6 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1452 microversion: 2.1 time: 0.169619 Nov 10 16:37:10.832246 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1218/2473] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:10 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:12.791290 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-0b8807b6-d07a-4b2b-9e22-2f265142539a req-9a2b083a-91d8-412f-bfd6-45e8cf30708c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ffa964-ba4a-45dd-8db7-075b875c47ee", "tag": "09a90f5c-76ef-44b3-8e11-be2e6786d0ae"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:37:12.793646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:37:12.793646 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:37:12.802204 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0b8807b6-d07a-4b2b-9e22-2f265142539a req-9a2b083a-91d8-412f-bfd6-45e8cf30708c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:12.802741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-0b8807b6-d07a-4b2b-9e22-2f265142539a req-9a2b083a-91d8-412f-bfd6-45e8cf30708c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:12.814771 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-0b8807b6-d07a-4b2b-9e22-2f265142539a req-9a2b083a-91d8-412f-bfd6-45e8cf30708c service nova] Creating event network-changed:09a90f5c-76ef-44b3-8e11-be2e6786d0ae for instance 61ffa964-ba4a-45dd-8db7-075b875c47ee on hv-cinder-81708 Nov 10 16:37:12.819903 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-0b8807b6-d07a-4b2b-9e22-2f265142539a req-9a2b083a-91d8-412f-bfd6-45e8cf30708c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032252 Nov 10 16:37:12.820494 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1256/2474] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:37:34.511867 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:37:34.512610 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:34.522067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:34.522765 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:34.523771 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:34.524205 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:34.550840 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lazy-loading 'flavor' on Instance uuid 07e7f07f-3721-436a-bdea-5b05ca7bca5a {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:37:34.666286 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-aec2a605-7693-4dcd-8be8-8a7906fa0d42 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "POST /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a/action" status: 202 len: 0 microversion: 2.1 time: 0.159903 Nov 10 16:37:34.666819 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1219/2475] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:37:34 2021] POST /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:37:34.678096 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:34.678922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:34.685687 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:34.686212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:34.687040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:34.687466 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:34.822186 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:34.830410 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-62e81990-0c57-4f93-9180-67d3cc59bde7 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.157283 Nov 10 16:37:34.831022 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1257/2476] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:34 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:35.853613 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:35.854422 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:35.862489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:35.862924 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:35.863685 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:35.864104 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:36.003928 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:36.011955 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-ef3f4a08-7db0-4058-bd88-c8946d9f5031 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.163195 Nov 10 16:37:36.012500 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1220/2477] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:35 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:37.040781 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:37.041769 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:37.052144 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:37.052893 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:37.054395 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:37.054905 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:37.205656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:37.213699 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f0cd4534-da20-4c5d-ba73-3924adbe5337 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.186390 Nov 10 16:37:37.214336 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1258/2478] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:37 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:38.231996 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:38.232564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:38.239022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:38.239463 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:38.240240 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:38.240676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:38.383482 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:38.390942 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-a7509d09-98f4-4e4a-8a38-68c22cd9bc15 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.163145 Nov 10 16:37:38.391502 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1221/2479] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:38 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:39.412079 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:39.412972 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:39.420981 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:39.421429 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:39.422198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:39.422663 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:39.575385 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:39.583557 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-04812bf7-0006-4336-92a6-50bff1aa9176 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.177734 Nov 10 16:37:39.584138 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1259/2480] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:39 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:40.605061 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:40.605983 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:40.616603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:40.617388 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:40.618181 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:40.618646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:40.780055 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:40.788210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-0a2433fc-9dc9-4b69-830c-794842fae22c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.189881 Nov 10 16:37:40.788889 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1222/2481] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:40 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:41.816817 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:41.817804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:41.825341 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:41.825776 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:41.826575 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:41.826998 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:42.037964 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:42.046143 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e2b038f1-1f46-4c4d-9459-c62858443ed5 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.235377 Nov 10 16:37:42.046751 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1260/2482] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:41 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:43.067480 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:43.068520 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:43.076013 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:43.076531 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:43.077218 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:43.077646 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:43.276126 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:43.285121 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-dd4044c5-ef63-4721-b04f-a0c1850796b1 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.223940 Nov 10 16:37:43.285688 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1223/2483] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:43 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:44.302665 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:44.303242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:44.310431 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:44.310897 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:44.311668 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:44.312106 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:44.470804 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:44.478639 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-f04da83d-632b-4f44-9549-75178d8937b8 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.179686 Nov 10 16:37:44.479219 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1261/2484] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:44 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:45.500764 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:45.501710 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:45.511200 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:45.511651 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:45.512456 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:45.512882 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:45.665529 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:45.673619 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-497ea717-044b-4560-a543-731f5043b891 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.179431 Nov 10 16:37:45.674129 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1224/2485] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:45 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:46.697233 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:46.698117 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:46.708843 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:46.709596 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:46.710928 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:46.711689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:46.862039 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:46.873874 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-d62c2bdb-bf8e-4904-b175-11530f1d6c41 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.182838 Nov 10 16:37:46.874700 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1262/2486] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:46 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:47.898841 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:47.899598 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:47.906971 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:47.907415 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:47.908191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:47.908621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:48.050035 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:48.058431 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-4b70d3cc-c8d2-47ac-8668-260657dd44c4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1509 microversion: 2.1 time: 0.166235 Nov 10 16:37:48.059022 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1225/2487] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:47 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:48.075003 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:37:48.076210 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:48.083128 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:48.083581 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:48.084364 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:48.084801 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:48.186662 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-922088f2-c048-4a8c-a48f-7de51b9efa1e tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "POST /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a/action" status: 202 len: 0 microversion: 2.1 time: 0.115372 Nov 10 16:37:48.187234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1263/2488] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Nov 10 16:37:48 2021] POST /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:37:48.197191 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:48.198118 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:48.203929 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:48.204379 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:48.205155 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:48.205584 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:48.380294 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:48.388023 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-838ca0c9-5be9-4d73-844c-f8a7bc8c5947 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1517 microversion: 2.1 time: 0.194993 Nov 10 16:37:48.388600 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1226/2489] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:48 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:49.405533 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:49.406104 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:49.412640 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:49.413116 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:49.414109 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:49.414694 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:49.554423 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:49.562871 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-caf769e5-cadb-4dbd-8242-1e87ceeb8d65 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.161902 Nov 10 16:37:49.563442 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1264/2490] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:49 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:50.584951 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:50.585850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:50.597318 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:50.598058 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:50.599386 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:50.600095 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:50.742231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:50.750648 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-758df504-c261-4fd9-93d2-4cc4edfb77e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.172079 Nov 10 16:37:50.751220 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1227/2491] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:50 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:50.781155 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-206d7ba9-bd4e-4046-9354-bde28a6d7a22 req-c9a15206-4eda-4ba8-a4af-017aedd7a461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "name": "network-vif-unplugged", "status": "completed", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:37:50.782735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:37:50.782735 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:37:50.790206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-206d7ba9-bd4e-4046-9354-bde28a6d7a22 req-c9a15206-4eda-4ba8-a4af-017aedd7a461 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:50.790653 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-206d7ba9-bd4e-4046-9354-bde28a6d7a22 req-c9a15206-4eda-4ba8-a4af-017aedd7a461 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:50.802741 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-206d7ba9-bd4e-4046-9354-bde28a6d7a22 req-c9a15206-4eda-4ba8-a4af-017aedd7a461 service nova] Creating event network-vif-unplugged:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:37:50.807704 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-206d7ba9-bd4e-4046-9354-bde28a6d7a22 req-c9a15206-4eda-4ba8-a4af-017aedd7a461 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030435 Nov 10 16:37:50.808555 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1265/2492] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:37:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:37:51.771573 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:51.772585 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:51.781074 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:51.781509 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:51.782292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:51.782712 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:51.934992 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:51.943627 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-b8ee1242-a3d3-4aed-b322-788ed49d57a0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.178345 Nov 10 16:37:51.944197 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1228/2493] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:51 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:52.964847 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:52.965774 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:52.974915 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:52.975514 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:52.976536 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:52.977063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:53.117952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:53.125922 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-5e63ade5-1c35-4340-8859-02bbd912081c tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.167292 Nov 10 16:37:53.126556 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1266/2494] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:52 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:54.147593 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:54.148580 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:54.157067 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:54.157506 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:54.158292 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:54.158754 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:54.312313 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:54.323790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-07646203-60b2-402f-bc0e-5806533b2ef3 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.182188 Nov 10 16:37:54.324564 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1229/2495] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:54 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:55.343563 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:55.344152 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:55.351036 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:55.351491 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:55.352262 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:55.352693 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:55.494782 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:55.502569 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-615edc3c-be91-4ba2-9384-3d511a7112c6 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.163905 Nov 10 16:37:55.503063 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1267/2496] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:55 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:56.520096 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:56.520671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:56.527256 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:56.527699 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:56.528481 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:56.528927 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:56.670375 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:56.680733 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-28369836-975a-4c32-aeec-3b89be6889d0 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1575 microversion: 2.1 time: 0.164468 Nov 10 16:37:56.681277 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1230/2497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:56 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:37:57.701388 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:37:57.701997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:37:57.708621 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:57.709077 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:57.709845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:37:57.710302 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:37:57.854819 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:37:57.863285 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-7d3fc09b-411a-4a7f-83c9-893e6e6aedcc tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1562 microversion: 2.1 time: 0.166009 Nov 10 16:37:57.863864 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1268/2498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:37:57 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:00.891032 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-fb49d1ce-530a-4f3e-92b6-719924bd918b req-cfb11d78-7f4d-4ee1-98f1-5c2e1cada3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "name": "network-vif-plugged", "status": "completed", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:38:00.892628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:38:00.892628 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:38:00.900423 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-fb49d1ce-530a-4f3e-92b6-719924bd918b req-cfb11d78-7f4d-4ee1-98f1-5c2e1cada3a4 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:00.900868 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-fb49d1ce-530a-4f3e-92b6-719924bd918b req-cfb11d78-7f4d-4ee1-98f1-5c2e1cada3a4 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:00.912972 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-fb49d1ce-530a-4f3e-92b6-719924bd918b req-cfb11d78-7f4d-4ee1-98f1-5c2e1cada3a4 service nova] Creating event network-vif-plugged:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:38:00.918254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-fb49d1ce-530a-4f3e-92b6-719924bd918b req-cfb11d78-7f4d-4ee1-98f1-5c2e1cada3a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 Nov 10 16:38:00.918919 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1231/2499] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:38:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:38:05.467322 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:38:05.468424 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:38:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:38:17.432113 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:38:17.432937 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:38:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:38:40.884710 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:40.885311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:40.889203 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-f08031b6-0e8a-41ef-993c-f08046b7001e req-8485ea60-699d-49f1-a16c-c49a048769f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ffa964-ba4a-45dd-8db7-075b875c47ee", "tag": "09a90f5c-76ef-44b3-8e11-be2e6786d0ae"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:38:40.890707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:38:40.890707 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:38:40.891812 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:40.892343 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:40.893137 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:40.893574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:40.898141 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-f08031b6-0e8a-41ef-993c-f08046b7001e req-8485ea60-699d-49f1-a16c-c49a048769f3 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:40.898850 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-f08031b6-0e8a-41ef-993c-f08046b7001e req-8485ea60-699d-49f1-a16c-c49a048769f3 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:40.912183 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-f08031b6-0e8a-41ef-993c-f08046b7001e req-8485ea60-699d-49f1-a16c-c49a048769f3 service nova] Creating event network-changed:09a90f5c-76ef-44b3-8e11-be2e6786d0ae for instance 61ffa964-ba4a-45dd-8db7-075b875c47ee on hv-cinder-81708 Nov 10 16:38:40.917495 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-f08031b6-0e8a-41ef-993c-f08046b7001e req-8485ea60-699d-49f1-a16c-c49a048769f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033592 Nov 10 16:38:40.918620 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1232/2500] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:38:40.921311 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:38:41.009918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-6bbb465a-33ea-49b8-8b05-8b7554ff98d1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 204 len: 0 microversion: 2.1 time: 0.128566 Nov 10 16:38:41.010932 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1269/2501] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:38:40 2021] DELETE /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:38:41.020345 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:41.021075 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:41.029315 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:41.029757 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:41.030871 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:41.031400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:41.175777 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:41.183216 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d5077312-9ddb-487e-8cc3-f028d78872ab tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1577 microversion: 2.1 time: 0.167935 Nov 10 16:38:41.183938 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1233/2502] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:41 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 10 16:38:42.204209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:42.204870 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:42.211661 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:42.212126 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:42.212936 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:42.213373 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:42.351296 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:42.359582 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fb9fa431-ef91-4f7e-8a2c-fa79314e22fd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1458 microversion: 2.1 time: 0.161626 Nov 10 16:38:42.360234 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1270/2503] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:42 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:43.046465 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-5203c8df-b495-45ab-b176-75e1ecb889b5 req-37b2a188-5452-4ee5-8bb2-252f79a7c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ffa964-ba4a-45dd-8db7-075b875c47ee", "name": "network-vif-deleted", "tag": "09a90f5c-76ef-44b3-8e11-be2e6786d0ae"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:38:43.048561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:38:43.048561 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:38:43.057980 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-5203c8df-b495-45ab-b176-75e1ecb889b5 req-37b2a188-5452-4ee5-8bb2-252f79a7c7e8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:43.058621 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-5203c8df-b495-45ab-b176-75e1ecb889b5 req-37b2a188-5452-4ee5-8bb2-252f79a7c7e8 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:43.071178 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-5203c8df-b495-45ab-b176-75e1ecb889b5 req-37b2a188-5452-4ee5-8bb2-252f79a7c7e8 service nova] Creating event network-vif-deleted:09a90f5c-76ef-44b3-8e11-be2e6786d0ae for instance 61ffa964-ba4a-45dd-8db7-075b875c47ee on hv-cinder-81708 Nov 10 16:38:43.079671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-5203c8df-b495-45ab-b176-75e1ecb889b5 req-37b2a188-5452-4ee5-8bb2-252f79a7c7e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037039 Nov 10 16:38:43.080321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1234/2504] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:38:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:38:43.377300 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:43.378004 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:43.384692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:43.385147 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:43.385952 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:43.386414 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:43.421914 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:43.422403 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:43.422891 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lazy-loading 'fault' on Instance uuid 61ffa964-ba4a-45dd-8db7-075b875c47ee {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:38:43.463242 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:43.471023 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1e0eb15f-990b-40b5-b0c0-f8f29c658642 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 200 len: 1231 microversion: 2.1 time: 0.097770 Nov 10 16:38:43.471630 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1271/2505] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:43 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:44.494226 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:44.494954 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 61ffa964-ba4a-45dd-8db7-075b875c47ee] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:44.505563 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:44.506048 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:44.507254 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:44.507833 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:44.524078 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] HTTP exception thrown: Instance 61ffa964-ba4a-45dd-8db7-075b875c47ee could not be found. Nov 10 16:38:44.524671 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Returning 404 to user: Instance 61ffa964-ba4a-45dd-8db7-075b875c47ee could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:38:44.525504 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-06b2d5e5-7714-45bd-9d8a-4084567123dd tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee" status: 404 len: 111 microversion: 2.1 time: 0.038229 Nov 10 16:38:44.526050 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1235/2506] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:44 2021] GET /compute/v2.1/servers/61ffa964-ba4a-45dd-8db7-075b875c47ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:38:47.910318 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:47.910924 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:47.912745 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-98de0412-6ad1-4cbe-a5c6-41b0b5ed21c5 req-aca25e8e-81b9-4b78-9284-cfe15979727c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640e6279-0099-4248-88ff-1f648b326504", "tag": "b9b9fbaa-5677-49dd-9654-90a164b0d4d2"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:38:47.914403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:38:47.914403 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:38:47.917927 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:47.918461 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:47.919250 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:47.919688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:47.922005 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-98de0412-6ad1-4cbe-a5c6-41b0b5ed21c5 req-aca25e8e-81b9-4b78-9284-cfe15979727c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:47.922676 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-98de0412-6ad1-4cbe-a5c6-41b0b5ed21c5 req-aca25e8e-81b9-4b78-9284-cfe15979727c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:47.934151 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-98de0412-6ad1-4cbe-a5c6-41b0b5ed21c5 req-aca25e8e-81b9-4b78-9284-cfe15979727c service nova] Creating event network-changed:b9b9fbaa-5677-49dd-9654-90a164b0d4d2 for instance 640e6279-0099-4248-88ff-1f648b326504 on hv-cinder-81708 Nov 10 16:38:47.939468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-98de0412-6ad1-4cbe-a5c6-41b0b5ed21c5 req-aca25e8e-81b9-4b78-9284-cfe15979727c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030596 Nov 10 16:38:47.940726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1236/2507] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:38:47.947808 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Going to try to terminate instance {{(pid=115910) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:38:48.032387 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-fd09c0a9-aa1a-4922-adb7-4ca25bf27220 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "DELETE /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 204 len: 0 microversion: 2.1 time: 0.125685 Nov 10 16:38:48.033529 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1272/2508] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:38:47 2021] DELETE /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:38:48.042177 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:48.042877 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:48.049080 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:48.049523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:48.050344 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:48.050779 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:48.200003 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:48.208778 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-d964ef92-3fc9-4977-801d-0a53ac37af92 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1575 microversion: 2.1 time: 0.170850 Nov 10 16:38:48.209512 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1237/2509] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:48 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:49.230040 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:49.230792 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:49.240692 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:49.241161 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:49.242291 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:49.242745 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:49.381520 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:49.388990 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-9e686544-6ff5-4961-82ec-3062171bde79 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1458 microversion: 2.1 time: 0.165482 Nov 10 16:38:49.389554 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1273/2510] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:49 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1458 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:50.075084 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [req-3f6e08e0-6d11-4add-ba58-29b901c82185 req-8a6010c6-d443-4b3a-b98c-cc43c03b010c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640e6279-0099-4248-88ff-1f648b326504", "name": "network-vif-deleted", "tag": "b9b9fbaa-5677-49dd-9654-90a164b0d4d2"}]} {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:38:50.076572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:38:50.076572 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: warnings.warn(msg) Nov 10 16:38:50.084062 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-3f6e08e0-6d11-4add-ba58-29b901c82185 req-8a6010c6-d443-4b3a-b98c-cc43c03b010c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:50.084491 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [req-3f6e08e0-6d11-4add-ba58-29b901c82185 req-8a6010c6-d443-4b3a-b98c-cc43c03b010c service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:50.096140 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.compute.server_external_events [req-3f6e08e0-6d11-4add-ba58-29b901c82185 req-8a6010c6-d443-4b3a-b98c-cc43c03b010c service nova] Creating event network-vif-deleted:b9b9fbaa-5677-49dd-9654-90a164b0d4d2 for instance 640e6279-0099-4248-88ff-1f648b326504 on hv-cinder-81708 Nov 10 16:38:50.101642 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [req-3f6e08e0-6d11-4add-ba58-29b901c82185 req-8a6010c6-d443-4b3a-b98c-cc43c03b010c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029937 Nov 10 16:38:50.102489 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1238/2511] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:38:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:38:50.406304 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:50.406918 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:50.414655 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:50.415121 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:50.415950 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:50.416374 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:50.449051 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:50.449497 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:50.449973 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.objects.instance [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lazy-loading 'fault' on Instance uuid 640e6279-0099-4248-88ff-1f648b326504 {{(pid=115910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:38:50.494259 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f2f94c57ce4d2a907db09a7e1398b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:38:50.502334 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-4d0e32aa-56e4-48f0-8a4d-f53e3e93a976 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 200 len: 1231 microversion: 2.1 time: 0.099718 Nov 10 16:38:50.502836 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1274/2512] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:50 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:38:51.523673 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:51.524259 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 640e6279-0099-4248-88ff-1f648b326504] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:51.531149 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:51.531595 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:51.532385 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:51.532818 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:51.546726 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] HTTP exception thrown: Instance 640e6279-0099-4248-88ff-1f648b326504 could not be found. Nov 10 16:38:51.547321 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Returning 404 to user: Instance 640e6279-0099-4248-88ff-1f648b326504 could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:38:51.548171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-40da56ef-44a6-4c5d-ace2-c3192ae125b1 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504" status: 404 len: 111 microversion: 2.1 time: 0.031507 Nov 10 16:38:51.548698 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1239/2513] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:51 2021] GET /compute/v2.1/servers/640e6279-0099-4248-88ff-1f648b326504 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:38:52.009151 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:52.009688 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:52.016206 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:52.016656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:52.017421 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:52.017856 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:52.032134 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] HTTP exception thrown: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. Nov 10 16:38:52.032715 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Returning 404 to user: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:38:52.033547 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-1c07e7fb-8818-41f8-af2f-7a30cc9b1662 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 404 len: 111 microversion: 2.1 time: 0.028543 Nov 10 16:38:52.034044 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1275/2514] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:38:52 2021] DELETE /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:38:52.042603 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:52.043395 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] [instance: 55ec1180-85f3-44ca-882a-5a667326ab9e] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:38:52.049832 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:52.050314 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:52.051085 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:38:52.051523 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:38:52.065330 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.wsgi [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] HTTP exception thrown: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. Nov 10 16:38:52.065917 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Returning 404 to user: Instance 55ec1180-85f3-44ca-882a-5a667326ab9e could not be found. {{(pid=115911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:38:52.066781 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-7509d4d9-7fd2-446c-abbe-617208ec5f9e tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e" status: 404 len: 111 microversion: 2.1 time: 0.028197 Nov 10 16:38:52.067360 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1240/2515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:38:52 2021] GET /compute/v2.1/servers/55ec1180-85f3-44ca-882a-5a667326ab9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:38:53.375580 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-e5d9ad61-f29a-45ef-9ae7-846caf92da38 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] Calling method '.version_select at 0x7faa9b605550>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:38:53.398500 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-e5d9ad61-f29a-45ef-9ae7-846caf92da38 tempest-TestVolumeBootPattern-1557460316 tempest-TestVolumeBootPattern-1557460316-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1422066139" status: 202 len: 0 microversion: 2.1 time: 0.026085 Nov 10 16:38:53.399212 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1276/2516] 10.222.0.60 () {58 vars in 1262 bytes} [Wed Nov 10 16:38:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1422066139 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:39:11.535845 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-16531607-8eb0-41c6-a903-9a35297dade2 req-debdeaf8-159b-4e63-a9f8-af2c0b1a7a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:39:11.539433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:39:11.539433 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:39:11.539758 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:11.540767 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:39:11.547156 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:11.548171 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:11.548356 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:11.548684 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-16531607-8eb0-41c6-a903-9a35297dade2 req-debdeaf8-159b-4e63-a9f8-af2c0b1a7a56 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:11.548790 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:11.549146 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-16531607-8eb0-41c6-a903-9a35297dade2 req-debdeaf8-159b-4e63-a9f8-af2c0b1a7a56 service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:11.560173 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-16531607-8eb0-41c6-a903-9a35297dade2 req-debdeaf8-159b-4e63-a9f8-af2c0b1a7a56 service nova] Creating event network-changed:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:39:11.565513 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-16531607-8eb0-41c6-a903-9a35297dade2 req-debdeaf8-159b-4e63-a9f8-af2c0b1a7a56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033885 Nov 10 16:39:11.566606 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1277/2517] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:39:11.577299 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Going to try to terminate instance {{(pid=115911) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 10 16:39:11.663383 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-3e533127-43d0-4d7e-bac2-c5981ef16cbb tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "DELETE /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 204 len: 0 microversion: 2.1 time: 0.134048 Nov 10 16:39:11.672796 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:11.673495 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:39:11.674961 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1241/2518] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Nov 10 16:39:11 2021] DELETE /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 10 16:39:11.679761 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:11.680209 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:11.680988 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:11.681420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:11.833156 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.policy [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115910) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:39:11.841574 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0f8cdbd7-5ac7-4d5a-ab4b-861a9bbe3611 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1568 microversion: 2.1 time: 0.172810 Nov 10 16:39:11.842420 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1278/2519] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:39:11 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:39:12.859887 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:12.860594 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:39:12.867557 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:12.868059 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:12.868847 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:12.869276 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:13.015019 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:39:13.024418 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-da605687-6206-4714-8f39-1bf6bb94b8f2 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1449 microversion: 2.1 time: 0.169021 Nov 10 16:39:13.024989 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1242/2520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:39:12 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:39:13.691469 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [req-8127574c-4d28-42da-9e31-7a4cc8bf0e9e req-df5c69dd-0610-461f-ad5a-f81cb147d8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e7f07f-3721-436a-bdea-5b05ca7bca5a", "name": "network-vif-deleted", "tag": "1af89801-bc9e-4c67-a4e5-8dcaff6ceabf"}]} {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 10 16:39:13.693198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 16:39:13.693198 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: warnings.warn(msg) Nov 10 16:39:13.703656 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-8127574c-4d28-42da-9e31-7a4cc8bf0e9e req-df5c69dd-0610-461f-ad5a-f81cb147d8fd service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:13.704102 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [req-8127574c-4d28-42da-9e31-7a4cc8bf0e9e req-df5c69dd-0610-461f-ad5a-f81cb147d8fd service nova] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:13.715561 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.compute.server_external_events [req-8127574c-4d28-42da-9e31-7a4cc8bf0e9e req-df5c69dd-0610-461f-ad5a-f81cb147d8fd service nova] Creating event network-vif-deleted:1af89801-bc9e-4c67-a4e5-8dcaff6ceabf for instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a on hv-cinder-81708 Nov 10 16:39:13.720589 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [req-8127574c-4d28-42da-9e31-7a4cc8bf0e9e req-df5c69dd-0610-461f-ad5a-f81cb147d8fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035471 Nov 10 16:39:13.721188 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1279/2521] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Nov 10 16:39:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 10 16:39:14.041653 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:14.042468 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.compute.api [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115911) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:39:14.051231 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:14.052026 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:14.056842 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:14.057430 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:14.100639 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:14.101127 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG oslo_concurrency.lockutils [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:14.102210 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.objects.instance [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lazy-loading 'fault' on Instance uuid 07e7f07f-3721-436a-bdea-5b05ca7bca5a {{(pid=115911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 10 16:39:14.144089 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.policy [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9490a34b4f24bf7aaac71813e784fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023a1b11c5d4cc2be900b25146d43d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115911) authorize /opt/stack/nova/nova/policy.py:199}} Nov 10 16:39:14.151607 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-35dab030-32c9-43c5-83ce-5171ec50d68f tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 200 len: 1224 microversion: 2.1 time: 0.113933 Nov 10 16:39:14.152272 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1243/2522] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:39:14 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 10 16:39:15.174861 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '>' {{(pid=115910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:15.175997 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.compute.api [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [instance: 07e7f07f-3721-436a-bdea-5b05ca7bca5a] Fetching instance by UUID {{(pid=115910) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 10 16:39:15.186855 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:15.187689 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:15.188604 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 10 16:39:15.189041 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG oslo_concurrency.lockutils [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Lock "27f0e8c4-5c31-4fe0-8e0a-0f5398eec656" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 10 16:39:15.202551 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.wsgi [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] HTTP exception thrown: Instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a could not be found. Nov 10 16:39:15.203375 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: DEBUG nova.api.openstack.wsgi [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Returning 404 to user: Instance 07e7f07f-3721-436a-bdea-5b05ca7bca5a could not be found. {{(pid=115910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 10 16:39:15.204192 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO nova.api.openstack.requestlog [None req-0280e9c0-46f8-4352-b589-52cef4f574e4 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a" status: 404 len: 111 microversion: 2.1 time: 0.037216 Nov 10 16:39:15.204750 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: [pid: 115910|app: 0|req: 1280/2523] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Nov 10 16:39:15 2021] GET /compute/v2.1/servers/07e7f07f-3721-436a-bdea-5b05ca7bca5a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 10 16:39:15.375792 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: DEBUG nova.api.openstack.wsgi [None req-497ca5f7-43a4-4081-8a09-bddfa884e522 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] Calling method '.version_select at 0x7faaad0fd4c0>' {{(pid=115911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 10 16:39:15.380079 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: ERROR oslo.messaging._drivers.impl_rabbit [None req-497ca5f7-43a4-4081-8a09-bddfa884e522 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [55ce231c-29d7-4ffa-9549-d73709a47d89] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 10 16:39:16.403337 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [None req-497ca5f7-43a4-4081-8a09-bddfa884e522 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] [55ce231c-29d7-4ffa-9549-d73709a47d89] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 34558. Nov 10 16:39:16.429769 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO nova.api.openstack.requestlog [None req-497ca5f7-43a4-4081-8a09-bddfa884e522 tempest-TestShelveInstance-1545023992 tempest-TestShelveInstance-1545023992-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1668738720" status: 202 len: 0 microversion: 2.1 time: 1.058629 Nov 10 16:39:16.430400 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: [pid: 115911|app: 0|req: 1244/2524] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Nov 10 16:39:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1668738720 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 10 16:41:25.494405 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:41:25.495543 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:41:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:41:37.457011 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:41:37.457888 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:41:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:41:43.721863 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:41:43.722902 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:41:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:41:50.063248 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:41:50.063844 dv-cinder-817085-2-iscsi devstack@n-api.service[115911]: Wed Nov 10 16:41:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 10 16:43:31.061345 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 10 16:43:31.062391 dv-cinder-817085-2-iscsi devstack@n-api.service[115910]: Wed Nov 10 16:43:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!